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ABSTRACT 



The Outcome Measures and Procedures Manual defines a wide range of measures 
of the outcomes (results or Impacts) of postsecondary education Institutions 
and their programs and suggests procedures for acquiring the data needed for 
each measure. 

The outcome measures described In the manual are ones Identified by a survey 
of Institutional and state-level decision makers as providing the Information 
most needed about the Impacts of postsecondary education. The survey Itself 
Is described In another NCHEMS document. The Higher Education Outcome Measures 
Identification Study (Micek and Arney, 1974). 

The procedures presented In the manual are suggested methods for collection 
of data on each particular outcome measure, often with several alternatives 
suggested. The procedures are not all -Inclusive, but rather are designed to 
suggest a starting point for Institutions wishing to collect the data. Most 
procedures are relatively straight-forward, relying primarily on two methods 
of data collection: (1) a questionnaire administered to those receiving the 
benefits of postsecondary education or to those who can determine how many 
persons received certain benv^flts, and (2) searches of Institutional records. 

The manual has been designed so that each outcome measure and Its associated 
data collection procedures are presented separately. As a result, the manual 
Is Intended to serve as a flexible and adaptable aid that allows Individual 
users to choose those outcome measures and related data collection procedures 
most relevant to their outcome Information needs. 
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PREFACE 



Decision makers in postsecondary education today are increasingly expressing 
the need for better information about the outcomes (results and impacts) of 
their institutions and programs. A multiplicity of pressures have accounted 
for this increased need. For example, a shrinking financial support base 
is compelling many institutions to reassess their missions and goals and to 
initiate more effective and efficient use of scarco resources. Further, 
shifting demands in the type and quality of educational goods and services 
are forcing institutions to examine how we11 they are meeting the changing 
demand structure. While information about institutional and program outcomes 
is not a cure-a11 for problems such as these, it can help institutions 
determine where they stand, assess how well they are- performiiig examine^ 
what impacts they are having, and identify directions they should pursue in 
the future. 

While postsecondary education decision makers have this important need for 
better outcome information, little progress has been made to date in helping 
them obtain and understand such information. For the most part, the difficulty 
rests with the complexities of identifying, measuring, and analyzing post- 
secondary education outcomes. 

The Outcome Measures and Procedures Manual has been developed to help decision 
makers deal with these problems. The manual has been designed to serve as a 
/ flexible and practical guide for acquiring the data necessary to obtain a wide 
range of outcome fnformation. It does this by presenting an array of alternative 
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procedures that can be used by Institutional researchers and planners to 
obtain local data for a select number of postsecondary education outcome 
measures (Indicators). 

The outcome measures and their associated data acquisition procedures contained 
In this field review edition of the manual have been developed In two phases. 
Phase I concerned the Identification of those outcome measures most needed by 
postsecondary education decision makers. Recognizing that the NCHEMS constituency 
Is composed primarily of Institutional and state*-1eve1 decision makers, the 
following types of decision makers were surveyed to determine the outcome 
measures they believed would help provide the outcome Information they need 
for carrying out their job responsibilities: 

1. Administrators from community colleges, public and private 
four year colleges, and public and private universities. 
The particular administrators surveyed In these Insti- 
tutions were the president and top-level administrators 
for academic planning, student affairs, and budget and 
finance. 

2. State directors of higher education and community/junior 
college governing boards and coordinating councils. 

3. State legislators who chair legislative committees concerned 
with education and approprlattons. 

Mailed questionnaires were used In the survey to solicit responses from the 
different decision makers In the sample. The list of outcome measures Included 
in the survey questionnaires was taken from NCHEMS Inventory of Higher Edu- 
cation Outcome Variables and Measures (Micek and Wallhaus, 1973). 
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Phase II was designed to develop operational definitions and data acquisition 
procedures for the top-priority outcome measures identified in Phase I. Major 
activities in the second phase included synthesizing procedures being used by 
institutions or individual researchers to acquire various types of outcome 
information and conducting special workshops to supplement staff efforts in 
the development of improved and new outcome measures and data acquisition 
procedures . 

This field review edition of the manual, which concludes the work of Phase II, 
is being published to solicit potential user's comments and suggestions about 
its organization, content, and overall utility. The review of the manual ^ 
also will include intensive pilot tests at selected institutions to assess 
the feasibility and usefulness of the outcome measures and data acquisition 
procedures contained herein. The results of this review process will be 
used to improve upon the manual, which will be published as a "first edition" 
document in 1976. 

With the purpose of the review of the manual Nn mind, you are invited and 
encouraged to provide comments and suggestions for improving the manual. Also, 
NCHEMS would appreciate receiving copies of: (1) any materials you develop, 
such as questionnaires, that incorporate versions of the measures and data 
acquisition procedures presented in the manual, and (2) the results of studies 
you undertake for which the manual has been used. 
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SECTION I 
OVERVIEW OF THE MANUAL 



Introduction 

Most decision makers concerned with postsecondary education recognize the 
need for information about the outcomes (results and impacts) of institutions 
and their programs for purposes of planning, management, and evaluation, and 
also for supporting and justifying long-range plans and budgets. These same 
decision makers are quick to point out, however, the complexities of identi- 
fying, measuring, and analyzing postsecondary education outcomes and of 
incorporating this information into the* planning, management, and evalua- 
tion process. Although these complexities will continue to plague efforts 
to obtain and use outcome information, the Outcome Measures and Procedures 
Manual is intended as a step forward in dealing with them. The manual does 
this by presenting an array of alternative procedures for obtaining a variety 
of potential measures or indicators of the outcomes of postsecondary institu- 
tions and their programs. The manual provides: 

1. A list of postsecondary education outcome measures or 
indicators that have been identified as highly relevant 

to the outcome information needs of institutions and state- 
level educational decision makers. 

2. Standard definitions of each outcome measure to facilitate 
communication among decision makers. > 

3. Specific procedures that can be used for acquiring data related 
to each outcome measure presented in the manual. 
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Five major criteria were used in selecting the outcome measures for 
inclusion in the manual and in developing the procedures for obtaining 
those measures: 

1. The manual should, to the extent possible, bridge the full 
range of postsecondary education outcome measures. Measures 
of the outcomes of the instruction, research, community 
service, and institutional support programs associated with 
various types of postsecondary institutions should be 
considered for inclusion in the manual. 

2. The outcome measures entertained for inclusion in the manual 
should reflect the fact that postsecondary education outcomes 
occur over an extended time period. Therefore, the manual 
should consider measures of both short-term and long-term 
outcomes. 

3. The outcome measures and their corresponding data acquisition 
procedures should reflect a recognition that the information 
needed by different decision makers varies considerably as to 
when it is needed and at what level of detail. 

4. The initial version of the manual should be primarily a compi- 
lation of the current state-of-the-art capability with respect 
to feasibility of outcome data collection. Future versions 
will incorporate improved and n.ewly developed outcome data 
acquisition procedures. 

5. The manual should be a flexible and adaptable tool from which 
users can pick and choose the procedures most appropriate for 
acquiring data related to the outcome measures they need. 

14 
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While the manual is intended to serve as a practical and flexible tool that 
can be used by many different audiences, it has been designed especially 
for use by persons responsible for educational planning, institutional 
research, and program evaluation activities in postsecondary institutions 
and agencies. Also, it has been designed to be used not only by single 
institutions and agencies but also by institutions and agencies that are 
involved in cooperative data collection and exchange efforts, such as 
institutional consortia. 

A Context for Using the Manual 

The Outcome Measures and Procedures Manual is just one of a series of products 
being developed as part of the Outcomes of Postsecondary Education project at 
the National Center for Higher Education Management Systems. 

Two other products that have been developed and relate to the manual include 
The Inventory of Higher Education Outcome Variables and Measures contained 
in NCHEMS Technical Report 40 (Micek and Wa11haus, 1973) and The Higher 
Education Outcome Measures Identification Stuc^y instrument and procedures 
(Micek and Arney, 1974). The Outcomes Inventory, which is presented in 
Appendix A, potentially has a number of uses, including the translation of 
broad institutional and program goals into measurable objectives and the 
setting of alternative program priorities. The Outcome Measures Identifi-* 
cation Study (OMIS) instrument and procedures were developed initially to 
help identify the measures for inclusion in this manual. However, they have 
been found to be useful to institutions in helping to determine the outcome 
information needs of a wide variety of individuals and groups. 

Us 

3 



While each of the products developed thus far in the Outcomes project can be 
used independently, they have been designed to support an "outcome-oriented" 
approach to educational planning, management, and evaluation. This approach 
emphasizes an explicit understanding of the outcomes of an institution or 
program at each stage in the planning, management, and evaluation cycle. 
Because an understanding of the "outcome-oriented" planning, management, 
and evaluation cycle is important for capitalizing fully upon the potential 

value of the manual, a description of the major components of that cycle and 

if-' ■ ■ . , 

the use of the manual therein follows. It should be noted, however, that 
this description is conceptual and not operational. 

As indicated in Figure 1, the first step in the outcome-oriented planning, 
management, and evaluation cycle concerns the selection of the planning 
focus, that is, designating the institution or program unit toward which 
planning, management, and evaluation efforts will be directed. Although 
this may appear to be an obvious prerequisite, inappropriate planning and 
data collection activities ofter are undertaken simply because the insti- 
tutional or program unit that will be the "unit of focus" has not been 
adequately defined in advance. For example, assessment of the outcomes of 
particular degree programs is impossible unless data are collected in such 
a way as to permit their disaggregation below the level of the total 
institution. 

One convenient guide for helping in the selection of the unit of focus is 
the NCHEMS Program Classification Structure (PCS), which is shown in Figure 
2. The PCS defines a hierarchy of organ izatibhal and program units ranging 
from the total institution down to individual program elements such as 

IG 
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Figure 1 

OUTCOME-ORIENTED PLANNING, MANAGEMENT, 
AND EVALUATION CYCLE 



SELECT PLAnNINC, FOCUS 
- the Institutional or program level 
that will be the focus of planning 



ESTABLISH GOALS 
- general or qualitative statements 
of the results that the planning 
unit Is Intended to produce 



DEFINE OQJECTIVFS 
* translfitions of the general 
goals into C|uantitat1vo 
measurable I'lnmio oiricom'i 



8. 



DETERMINE INFORMATIOU RCQUIREMEUTS 
- outcome and related Infonnation 
necessary to assess the extent to 
which the deslrqd outcon:es are 
actually produced 


N 




COLLECT IMFORHATK 
* the nicchanica 
aspects of ac 
necessary 1nf( 


1 and procedural 
tually acquiring the 
)nnat1on 



4. 



DEFINE ALTERNATIVE ACTIVITIES 
- delineation of the range of 
feasible activities and of the 
BXPECim ovTcoi€<s Of such activities 



SELECT ACTIVITIES 
• choite of alternatives whose 

EXVECTED OViWr-iFS niost nearly match 
the mint{:D pV'jCO!*T.s and- still satisfy 
resource" constraints 



7. 



IMPLEMENT ACTIVITIES 
«• application of the planning unit's 
resources to the conduct of the 
selected activities 



ANALYZC INFORMATION 
• analysis of outcome and other 
information for purposes of 
description of Acn'Ai opim'-iFS .. 
comparison with desired"'ane expected 
outcomes, explanation of variances, 

and prediction of future perTonnance 



10. 



UVILIHE INFORMATION 
- the incorporation of results into 
ongoing planning cycle through 
feedback process 



(Feedback) 
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courses. It should be noted, however, that the data collection procedures 
contained In this manual do not lend themselves to the measurement and 
analysis of outcomes at the individual course or program element level of 
the PCS* 

Once the unit of focus Is determined, the goals of the unit must be estab- 
lished (Step 2). Such goals Ideally are based on the unit's overall mission 
and on assessment of constituents' needs. They also are typically rather 
broad statements of the desired results and Impacts that are to be accomp- 
lished by the Institution or program In focus. The Inventory of Higher 
Education Outcome Variables and Measures (Micek and Wa11haus, 1973) can 
play a useful role at this point (see Appendix A). The outcome variables 
listed In the Inventory are helpful In defining the range of possible goals 
that might be adopted. Among other Instruments that a1?o may be relevant 
Is the Institutional Goals Inventory (Peterson, 1971) developed by the 
Educational Testing Service. The IGI Instrument has been deislgned to solicit 
opinions about ''what are" the goals of an Institution and "what should be" 
the goals. 

The next step In the outcome-oriented planning, management, and evaluation 
cycle (Step 3) concerns translating the broadly stated goals of the unit In 
focus Into operationally stated objectives, that Is, objectives stated In 
terms of specific, measurable, desired outcomes . The Inventory of Higher 
Education Outcome Variables and Measures can also be most useful In this 
step of the cycle since It Identifies a variety of specific outcome measures 
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that potentially reflect a wide range of outcome-oriented goals (or in the 
terms of the Inventory—outcome variables). Appendix A, in addition to 
presenting the Inventory, presents a set of guidelines that describe how 
the lists of potential outcome variables and measures in the Inventory can 
be used to translate broadly stated goals into specific measurable objectives. 

In Step 4, which parallels Step 3, the range of alternative courses of action 
(alternative activities) that the unit in focus might undertake to achieve 
the desired outcomes is delineated. Included in the identification of the 
feasible alternatives is the definition of a set of expected outcomes asso- 
ciated with each alternative being considered. 

The distinction made in the outcome-oriented planning, management, and eval- 
uation cycle between desired outcomes and expected outcomes is an important 
one. It is intended to make planners focus on what outcomes can realistically 
be expected from a particular alternative. Too often, planners identify the 
outcomes that are desired but never adjust their expectations after selecting 
a given alternative, which may be designed to produce only part of the desired 
outcomes because of such factors as resource and environmental constraints. 

Once the expected outcomes of each alternative under consideration and the 
desired outcomes identified in the objective-setting step are determined, 
they become input to the activity selection step (Step 5) of the cycle. 
In the activity selection step, the set of desired outcomes and the set of 
expected outcomes associated with each alternative are compared to one 
another so that a decision can be made about which alternative will produce 
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the results and impacts that most closely match the desired outcomes . In 
practice, however, the activity selection decision also must take into 
account resources and other constraints. Therefore, the expected outcomes 
of an alternative are likely to be somewhat less ambitious than the desired 
outcomes > 

Once the decision has been made concerning the alternative to be Implemented, 
It becomes possible to determine specific outcome and related data (resource, 
process, and environmental data) requirements that will be necessary to 
assess the extent to which the expected outcomes of the selected alternative 
are accomplished (Step 6). Resource, process, and environmental data are 
necessary because outcome data considered In Isolation from these mitigating 
factors may have very little meaning or utility for planning, management, 
and evaluation purposes."^ 

Step 7 In the cycle represents the actual Implementation of the selected 
alternative. At the same time, the process of collecting the outcomes and 
related data should be undertaken (Step 8). It is at this point that the 
Outcome Measures and Procedures Manual (OMPM) plays a paramount role since 
it provides procedures for acquiring the outcome data that are reflective 
of the expected outcomes . Procedures for using the OMPM to accomplish this 
task will be described in more detail later in this section. 

After the outcome and related data have been collected, they can be analyzed 
for purposes of assessing and understanding the actual outcomes that result 

*NCHEMS Technical Repor't 35, Program Measures (Topping and Miyataki, 1973), 
can be very helpful in identifying the other kinds of data that might be 
appropriate for interpreting the outcome data that will be collected. 
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from the alternative that was implemented (Step 9). Interest here may center 
on simple descriptions of the outcomes that result or may concern an expla*- 
natlon of why certain outcomes occurred or didn't occur. Another objective 
may be the comparison of the actual outcomes with both the desired and the 
expected outcomes Identified earlier. Analysis also may be directed toward 
prediction of future Institutional or program performance. 

Finally, the information that results from the analysis should be used as 
feedback for future planning activities (Step 10). This aspect of the 
outcome-oriented planning, management, and evaluation cycle Is extremely 
Important. Unless the results of each cycle are Incorporated Into the next^ jr 
cycle, the entire process runs the risk of degenerating Into an Interesting, 
but not particularly useful, exercise. 

As previously mentioned, the description of the outcomes-oriented planning, 
management, and evaluation cycle presented above is conceptual and not 
operational. Furthermore, viewing the cycle as a strictly sequential process 
will be deceiving. In practice, it is often encessary to retrace and redo 
certain steps on the basis of experience ^later in the cycle. Thus, for example 
the objective-setting step (Step 3) may cause some rethinking of the general 
goals identified in Step 2. ^ Similarly, an attempt to use outcome information 
as feedback may reveal new needs for analysis or even entirely new pieces 
of information. 

In trying to implement the outcome-oriented planning, management, and evalu- 
ation cycle, there should be no illusion that it is an easy task. For one 
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thing, the specific desired outcomes of an institution or program are difficult 
to identify and agree upon because the goals and values of individuals, programs, 
and institutions differ. Furthermore, even when desired outcomes or objec*- 
tives are identified and consensus is reached, few explicit criterion measures 
or indicators of actual institutional and program outcomes are available. 
Finally, in cases where planners and decision makers have information about 
an institution's or program's outcomes, they have much difficulty inter- 
preting the information, since procedures for analyzing and using the infor- 
mation often are not adequate or are not understood. Such difficulty can 
be attributed to a host of factors: the complexity of postsecondary education 
systems, multiple and joint products and impacts, unintended side effects, 
paucity of adequate statistical techniques for effective data analysis, and 
lack of sufficient data bases for interprogram and interinstitutional com- 
parison. It is hoped, however, that the Outcome Measures and Procedures 
Manual will be a useful tool in beginning to deal with these difficulties. 

Content of the Manual 

This field review edition of the Outcome Measures and Procedures Manual 
presents definitions and data acquisition procedures for a group of post- 
secondary education outcome measures that have been identified as high 
priority in terms of the outcome information needs of institutional planners 
and managers and state-level decision makers. These priorities are based 
on the inputs of the NCHEMS Outcomes of Postsecondary Education Project task 
force and the results of the Higher Education Outcome Measures Identification 
Study (Micek and Arney, 1974). The Outcome Measures Identification Study 
was designed to have institutional administrators (presidents and top-level 



administrators for academic planning, student affairs, and budget and finance) 
and state-*1eve1 decision makers (state directors of higher education agencies 
and state legislators) identify those outcome measures that are of high 
importance for helping provide the outcome information they need for carrying 
out their various decision-making responsibilities. 

The outcome measures and their associated data acquisition procedures presented 

in this manual have been organized into the three major sections that follow 

this overview section: 

Section II: Student Growth and Development Measures 
and Procedures 

Section III: New Knowledge and Art Forms Measures 
and Procedures 

Section IV: Community Development and Service Measures 
and Procedures 

While these three sections correspond to the major sections of the NCHEMS 
Inventory of Higher Education Outcome Variables and Measures presented in 
Appendix A, the categories within each section do not match up exactly with 
those in the Outcomes Inventory. (Figure 3 on the next page presents the 
structure used to organize the outcome measures and data acquisition pro- 
cedures contained in the manual.) 

'•4 

For each outcome measure contained in Sections II, III, and IV, a one-page 
abstract is presented that provides: 

1. The name of the outcome measure. 

2. The number used to categorize the measure. 

3. A definition of the measure. 
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Figure 3 

OUTCOME MEASURES AND PROCEDURES CATEGORIES 



STUDENT GROWTH AND DEVELOPMENT 

A. Student Knowledge and Skills Development 

- Measures and procedures concerning student understanding, competencies, and attitudes relative 
to bodies of facts and principles and use of their Intellectual and physical abilities. 

6. Student Educational Career Development 

- Measures and procedures concerninq student attitudes and success relative to certain academic 
pursuits, e.g., student educational degree aspirations and attainments. 

' ''0 

C. student Educational Satisfaction 

- Measures and procedures concerning the satisfaction of students about the knowledge and skills 
they have acquired and their progress toward their educational and occupational career 
objectives. 

D. Student Occupational Career Development 

- Measures and procedures concerning student attitudes and success relative to certain 
occupational goals and their job performance. 

E. Student Personal Development* 

- Information about changes In students concerning the growth and maintenance of their personal 
life, e.g., their ability to adapt to new situations, their self-concept. 

F. Student Social /Cultural Development* ^ 

- Information about student abilities and attitudes In dealing with people and their Interest 
In cultural activities. 

NEW KNOWLEDGE AND ART FORMS 

G. Development of New Knowledge 

- Measures and procedures concerning forms of new knowledge developed, applied, and reorganized" 
by an Institution's programs and Its faculty, staff, and students (current and former). 

H. Development of Art Forms* 

- Measures and procedures concerning forms of art, e.g., a musical score, a play, a sculpture, 
created by an Institution's programs and its faculty, staff, and students (current and former). 

COMMUNITY IMPACT 

I. Community Impact: Education 

- Measures and procedures concerninq the attitudes and success of non^degree/diploma/certificate 
participants relative to their acquisition of knowledge and skills, personal and social 
development, and occupational career goals and performance. 

J. Community Impact: Service 

- Measures and procedures concerning the impact of the opportunities and services provided by the 
Institution and received by the community, e.g., agricultural extension services, cultural and 
recreational opportunities. 

K. Community Impact: Economic 

- Measures and procedures concerning the impact of an institution's programs and its faculty, 
staff, and students (current and former) on the financial health and manpower supply of the 
conmunlty (local, state, or national). 



*In this version of the Manual there are no measures and procedures presented 
for three categories: Student Personal Development, Student Social /Cultural 
Development, and Development of Art Forms. These omissions reflect the priorities 
established as a result of NCHEMS Higher Education Outcome Measures Identi- 
fication Study. Later versions of the Manual may include measures 
appropriate for these categories. 
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4. The data sources from which the data needed for the 
measure can be obtained. 

5. A listing of the general type of procedures reconwnended 
for obtaining the measure. 

6. CoiTinents that may be useful in understanding the use 
of the measure and its acquisition procedures. 

* 

A blank copy of the abstract sheet is shown in Figure 4. Following the 
one-page abstract for each measure, the data acquisition procedures suggested 
for that measure are presented. In some instances, alternative procedures are 
presented to give the user as much flexibility as possible in acquiring the 
data necessary for the measure. For instance, procedures may differ with respect 
to data collection mechanisms (institutional records versus questionnaire 
surveys) or data sources (surveys of exiting students, former students, or 
administrative staff). 

Procedures for Using the Manual 

Using the Outcome Measures and Procedures Manual should Hft a fairly straight- 
forward process. Figure 5 outlines the major steps involved. The first step 
actually does not involve use of the manual at a11, but rather is prerequisite 
to using it— the determination of outcome information requirements . There are 
various purposes for or reasons why one might be interested in collecting 
outcome information: (1) the need to assess the extent ,to which certain 
institutional or program objectives are being met, (2) the need to answer a 
particular question related to some problem that must be solved, and (3) the 
need to be accountable to some external governing or funding body, such as a 
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Figure 4 



A SAMPLE OF THE ABSTRACT SHEET USED TO 
INTRODUCE EACH MEASURE AND ITS RELATED PROCEDURES 



I MEASURE NAME 



NATIONAL CENTER FOR HIGHER EDUCATION MANAGEMENT SYSTEMS 
Outcome Measures and Procedures Manual 



MEASURE 
NUMBER 



Idefinition 



DATA SOURCES 



I PROCEDURES 
ICOHWENTSl 
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Figure 5 
USE OF THE MANUAL 



PREREQUISITE: 

Determination of outcome 
information requirements 



INFORMATION 
COLLATION STAGE 
OF OUTCOME-ORIENTED^ 
PLANNING CYCLE 



Determine which o 
requirements can 
measures contalne 


utcome Information 
be satisfied by 
d In OMPM 




r 


For each required outcome measure, 
select the most appropriate data 
acquisition procedures from those 
available In the OMPM 


> 


f 


Integrate OMPM da 
procedures Into a 
collection plan 


ta acquisition 
n overall data 



Implement outcomes data 
collection plan 



>v 

REMAINING STEPS: 
Analysis of data 
Utilization of i nf ormati on 
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board of trustees or a state legislative appropriations committee. In estab- 
lishing the plan for collecting the outcome information, th'e design of the study 
required by the questions or hypotheses of interest needs to be developed, 
the sampling procedures need to be determined, and the variables to be 
measured need to be identified. 

Once the outcome information requirements have been identified, the user 
can begin determining which outcome measures included in the manual will 
help in satisfying the outcome information requirement. This can be done 
by going to Sections II, III, and IV of the manual and picking the relevant 
outcome measures. 

For each of the outcome measures that help satisfy the outcome information 
requirements, the user should assess the appropriateness of the data acqui- 
sitfon procedures recommended in the manual. In some instances, the user will 
have to choose between alternative data collection procedures for an indivi- 
dual measure. While adaptations of the procedures will need to be made for 
the unique purposes of each study, the procedures for obtaining the outcome 
measures have been developed so that users usually will have to make only 
minimal modifications. 

In using the manual it is important to note that the data acquisition procedures 
presented involve the use of survey questionnaires and institutional records. 
Because it is anticipated that survey questionnaires will be employed quite 
frequently, guidelines for developing, administering, and processing survey 
questionnaires are presented in Appendix D of the manual. 
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Although the outcome measures and associated data acquisition procedures are 
presented individually irt the manual, prospective users wi11 most likely use 
combinations of these measures and procedures because of their wide range of 
outcome information needs. Thus, the final major step in using the manual is 
to integrate the selected procedures into the established overall information 
collection plan. This may include developing an exiting student questionnaire, 
a follow-up questionnaire for former students, a community input survey ques- 
tionnaire, a faculty activity questionnaire, and so forth. Once this is done 
the user can implement the data acquisition procedures according to the over- 
all plan. 

Limitations of the Manual 

As with any document of this type, certain limitations are present. The most 
important limitations of this version of the Outcome Measures and Procedures 
Manual are as follows; 

1. The outcome measures included in this manual represent only a 
limited subset of all the potential measures of postsecondary 
education outcomes. Measures, that are included, however, are 
cnnsistent with the priorities expressed by the institutional 
administrators and state-level decision makers surveyed in the 
NCHEMS Higher Education Outco[ne Measure^ Identification Study. 
The Inventory of Higher Education Outcome Variables and Measures 
presented in Appendix A provides a more comprehensive view of 
the range of possible postsecondary education outcomes. 
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The measures and acquisition procedures presented in this manual 
generate only outcome Information. Although outcome Information 
Is basic to the outcome-oriented planning, management, and 
evaluation cycle. It Is Important to point out that Information 
about the resources and processes associated with the program 
or organization unit In focus also Is necessary for describing 
and explaining the outcomes of those units. 
Only those outcomes that are measurable or observable, that Is, 
quantifiable outcomes, are Included In the manual. 
The data acquisition procedures In the manual deal only with 
Institutionally collected Information. Modifications probably 
will be necessary If the procedures are to be used by persons 
who are not Institutionally based, such as state-level educa- 
tional planners and decision makers. 



3jL 

19 



SECTION II 
STUDENT GROWTH AND DEVELOPMENT 
MEASURES AND PROCEDURES 

The outcome data acquisition procedures presented in this section are intended 
to obtain selected outcome measures that potentially reflect the outputs and 
impacts of postsecondary institutions and their programs relative to the broad 
area of student growth and development. Decision makers might be interested 
in one or more of these outcome measures for a variety of reasons: the 
measures may reflect the goals of an institution or a program therein, they 
may provide information needed for curricular and instructional development 
decisions, they may suggest areas for improved cotinseling and advising of 
students, and they may indicate why students are satisfied or dissatisfied 
with their educational progress and their ability to pursue their desired 
profession. 



The data acquisition procedures included in this section pertain to the 
following outcome measures: 

A. Student Knowledge and Skills Development Outcomes 

Student development concerning breadth of knowledge 
Student development concerning depth of knowledge 
Student success in passing certification and licensing 
examinations 

Areas and agents of student change during college 

Student Educational Career Development Outcomes 

Highest degree or certificate planned 
Students enrolled in an organized educational 
activity for no credit 

Program completers during a certain time period 
Program completers who entered as transfer students 
Degrees and certificates earned by an entering class 
of students 



A-1 

A-2 
A-3 

A-4 



B-1 
B-2 

B-3 
B-4 
B-5 
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B-6 Time to program completion for a graduating class 
B-7 Time to program completion for an entering class 
B-8 Educational program dropouts 

B-9 Students seeking additional degrees and certificates 
B-10 Students working toward and receiving another degree 

or certificate 
B-11 Student ability to transfer credits 
B-12 Level of achievement of former students in another 

institution 

C. Student Educational Satisfaction Outcomes 

C-1 Student satisfaction with overall educational experience 
C-2 Student satisfaction with vocational preparation 
C-3 Student satisfaction with knowledge and skills in the 
humanities 

C-4 Student satisfaction with critical thiu'n'ng ability 
C-5 Student satisfaction with human relations skills 

D. Student Occupational Career Development Outcomes 

D-1 Student success in obtaining f i rst job 

D-2 Student success in obtaining preferred first job 

D-3 Occupational career choice 

D-4 Job satisfaction 

D-5 First job earnings 

D-6 Annual total income of former students 

D-7 Employment in major field of study 

0-8 Change and stability of career goals 

E. Student Personal Development (No outcome measures and data 
acquisition procedures are presented in this category in this 
version of the manual •) 

F. Student Social/Cultural Development (No outcome measures and 
data acquisition procedures are presented in this category in 
this version of the manual.) 



In most instances, 'the results of NCHEMS's Higher Education Outcome Measures 
Identification Study were the determining factor in selecting the measures 
for inclusion in this section. 

In using any of the student outcome measures presented here, consideration 
should be given to variables concerning student inputs, the institutional 
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environment, and the educational process that potentially relate to those 
outcome measures. For example, student demographic variables, such as 
age, sex, race» residence, and marital status, should be considered. Also, 
student activity variables, such as major field of study, work experience, 
degrees earned, and grade point average, need to be considered. 

Among Institutional environment and educational process variables, certainly 
differences In faculty morale and campus Intellectual orientation would be 
expected to have different effects on student growth and development out- 
comes. Furthermore, the Institution's organizational structure, the dif- 
ferent types of Instructional methodologies and arrangements, and faculty 
accessibility to students may be Important factors. Extra-Institutional 
variables such as the po11t1ca1-soc1a1 arvlronment and job opportunities 
also should be examined for their relationships to any of the student out- 
come measures. 

A good start on reviewing relationships of student outcomes to other factors 
has been made by Feldman and Newcombe (1969) and by Lenning and associates 
(1974, 1975). 
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student Knowledge and Skills Development Outcomes 



A-1 Student development concerning breadth of knowledge 
A-2 Student development concerning depth of knowledge 
A-3 Student success In passing certification and 

licensing examinations 
A-4 Areas and agents of student change during college 
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NATIONAL CENTER FOR HIGHER EDUCATION MANAGEMENT SYSTEMS 
Outcome Measures and Procedures Manual 



A-1 

MEASURE 
NUMBER 



1EASURE NAME 



student development concerning breadth of knowledge 



DEFINITION 



student scores on tests that Indicate development In their breadth of 
knowledge about facts and principles across several broad fields of 
study (the hMmanltles, the physical sciences, etc.) 



DATA SOURCES 



Current Students, Exiting Students, Former Students 



PROCEDURES 



Administration of standardized achievement tests 



COMMENTS 



This outcome measure is identified as a potential measure of General 
K nowledge (1.1.1.01) in the NCHEMS Inventory of Higher EducatTon 
Outcome Variables and Measures. .see Appendix A. 
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ACQUISITION PROCEDURES FOR OUTCOME MEASURE A-1 

The data acquisition procedures most widely used to assess student devel- 
opment in their breadth of knowledge ir the survey achievement test. Generally, 
such tests represent a standardized package of separate tests that cover the 
basic knowledge and skill components of the curriculum. Because a variety of 
standardized achievement tests already have been developed, NCHEMS has chosen 
to recommend their use in obtaining data for outcome measure A-1. Probably the 
best source of information for deciding which achievement test best fits the 
situation in which it will be used is the series of Mental Measurements Yearbooks 
developed by Oscar K. Buros (1938, 1941, 1949, 1953, 1959, 1965, 1972). The 
following achievement test batteries, which may be useful in obtaining outcome 
measure A-1, are reviewed in Volume I of the seventh edition of the Mental 
Measurements Yearbook : 

- Adult Basic Education Student Survey (Follet 
Educational Corporation, 1966-67) 

- Adult Basic Learning Examination (Harcourt, 
Brace, Jovanovich, Inc., 1967-71) 

- College-Level Examination Program General 
Examination (College Entrance Examination 
Board, 1970) 

- Survey of College Achievement (Educational 
Testing Service, 1966-69) 

- Tests of General Educational Development (The 
American Council on Education, 1970} 

- The Undergraduate Record Examinations: Area Tests 
(Educational Testing Service, 1954-70) 
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NATIONAL CENTER FOR HIGHER EDUCATION MANAGEMENT SYSTEMS 
Outcome Measures and Procedures Manual 



A-2 

MEASURE 
NUMBER 



1EASURE NAME 



student development concerning depth of knowledge 



)EFINITION 



student scores on tests that indicate development in their depth of knowledge 
concerning facts and principles in the particular fields in which students 
elect to study. 



DATA SOURCES 



Current Students, Exiting Students, Former Students 



PROCEDURES 



Administration of standardized achievement tests 



COMMENTS 



This outcome measure is identified as a potential measure of Specialized 
Knowledge (1.1.1.02) in the NCHEMS Inventory of Higher Education Outcome 
variables and Measures. .see Appendix A. 
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ACQUISITION PROCEDURES FOR OUTCOME MEASURE A-2 



Numerous standardized achievement tests have been developed to help assess 
student knowledge and sk111 development in special areas of study. Because 
of their existence, NCHEMS recommends their use in obtaining data for outcome 
measure A-2, As is true for outcome measure A-1, Buros' Mental Measurements 
Yearbooks (1938, 1941, 1949, 1953, 1959, 1965, 1972) are probably the best 
source of information for deciding which achievement tests best fit the 
^ situation in which they will be used. Volumes I and II of the seventh 

edition of the Mental Measurements Yearbook list standardized instruments for 
the following specialized fields of study: 



English 
Fine Arts 
Foreign Languages 
Mathematics 
Business Education 
Education 

Health and Physical 



Economics 
Geography 
History 

Political Science 
Sociology 

Speech and Hearing 

Accounting 

Business 

Computer Programming 

Dentistry 

Engineering 

Law 

Medicine 

Nursing 

Selling 

Skill Trades 

Supervision 

Transportation 



Education 
Home Economics 
Industrial Arts 
Philosophy 
Psychology 
Religious Education 
Reading 
Biology 
Chemistry 
Geology 
Physics 
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NATIONAL CENTER FOR HIGHER EDUCATION MANAGEMENT SYSTEMS 
Outcome Measures and Procedures Manual 



A-3 



MEASURE 
NUMBER 



MEASURE NAME 



Student success in passing certification and 
1 1 cens 1 ng exami nati ons 



DEFINITION 



Number and percentage of students and/or former students passing certification, 
licensing, or qualification examinations (e.g.. Bar Exam, CPA Exam, LPN Exam) 



DATA SOURCES 

Exiting Students, Former Students 



PROCEDURES 

Administration of a survey questionnaire * 

COMMENTS ~' 



This outcome measure is identified as a potential measure of Specialized 
Knowledge (1.1.1.02) in the NCHEMS Inventory of Higher Education outcome 
Variables and Measures— see Appendix A. 

Although the administration of a survey questionnaire Is the acquisition 
procedure suggested for obtaining data for outcome measure A-3, It is 
recognized that the data necessary for this measure often can be obtained 
from the agencies or organizations that administer the exams. 
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ACQUISITION PROCEDURES FOR OUTCOME MEASURE A-3 

The procedure recomnended for determining student success In passing certi- 
fication and licensing examinations involves the development and use of a 
survey questionnaire. Because data for this measure can be obtained from 
students as they leave the institution and from former students sometime 
after they have left, one set of questionnaire items has been developed 
for inclusion in an EXITING-STUDENT Questionnaire and another set for inclu- 
sion in a FORMER-STUDENT Questionnaire. 

Procedures for an EXITING-STUDENT Questionnaire 

The following items that have been developed for inclusion in an EXITING- 
STUDENT Questionnaire to obtain data for outcome measure A-3 can be used in 
questionnaires designed to survey program completers as well as program 
noncompleters . It should be noted, however, that these items could be used 
also to survey students not in degree, diploma, certificate programs, that 
is, nonmatriculating students. 
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1. Have you taken or are you p^lannlng to take some type of certifying, 
licensing, or guallfying exam (such as Licensed Practical Nurse exam 
or Bar exam) either Immediately after completing your program at 
(Name of Institution) or at some future date? 

0) Yes (60 TO QUESTION 2) 

_(2) No (SKIP TO QUESTION ) 

{3) Don't Know (SKIP TO QUESTION ) 

2. If you answered "Yes" to question 1, how many times have you taken 
the exam? (Please check one.) 

(1) I have not taken It 

{2) Once 

(3) Twice 

{^) More than twice 



3. If you have taken the exam, did you pass It? 
(1) Yes 

(2) No 

{3) Don't know 

4. In the space below, please describe or give the name of the exam you 
have taken (or have to take). 
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Procedures for a FORMER-STUDENT Quest innnai>o 



The following questionraiV?| items are Intended for use in obtaining out- 
come measure A-3 from former students regardless of whether or not they 
completed their program. 



1. 



exami^atfnn^*° ^""^ ^^"^ °^ certifying, licensing or qualifying 
l^^TinTlN^I^finltM/^^^*^'"^ ^"^^^ - «^te? 



_(1) Yes (60 TO QUESTION 2) 
.(2> No (SKIP TO QUESTION 



2. How many times did you take the exam? (Please check one.) 
(1) I have never taken it 



(2) Once 



(3) Twice 



_(4) More than twice 



3. 



If you did take the exam, did you pass it? 

0) Yes 

(2) No 

(3) Don't know 



^' hSd*to toke- "^^^^^ describe or give the name of the exam you 
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NATIONAL CENTER FOR HIGHER EDUCATION MANAGEMENT SYSTEMS 
Outcome Measures and Procedures Manual 



1EASURE NAME 



Areas and agents of student change during college 



A-4 

MEASURE 
NUMBER 



DEFINITION 



student scores on a scale measuring their perceptions about how much they 
changed in certain areas as a result of experiences with various "change 
agents" (persons, events, facilities, or organizations) associated with 
the institution. 



DATA SOURCES 



Exiting Students, Former Students 



PROCEDURES 



Administration of a survey questionnaire 



COMMENTS 



This outcome measure is identified as a potential measure of a student's 
Intellectual Disposition (1.1.3.01) and Change/Stability (1.3.2.02) in the 
NCHEMS Inventory of Higher Education Outcome Variables and Measures— see 
Appendix A. 
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ACQUISITION PROCEDURE FOR OUTCOME MEASURE A-4 



Two alternative procedures are suggested for obtaining student perceptions 
about the areas in which they have changed as a result of experiences with 
certain "change agents" during college. The first alternative is a modifi- 
cation of a procedure developed by Evert K. Wilson at Antioch College and 
is described in a book he co-authored with Theodore Newcomb, College Peer 
GrouEs, (1966). The procedure represents a straight-forward approach of 
asking a student two basic questions: "As you reflect upon your college 
experience, what do you see as significant changes in yourself which have 
occurred during this period?" and "How did these changes come about?" The 
data obtained from the use of this procedure may suggest answers to questions 
such as: (1) Who or what are the agents of change cited by students? 
(2) Where does a particular change agent appear to stand among other agents 
of change? (3) What are the kinds of changes that students deem significant— 
for example, Wilson was interested in those student changes pointing to vari- 
ables that might prove of interest in research on peer groups' influence. 
(4) How does strength of a particular change agent's influence shift from 
one type of variable to another? 

The second alternative procedure has been used in the NCHEMS Information 
Exchange Procedures project's "Student Outcomes Questionnaire for Program 
Completers" (Byers, 1975). The procedure is designed to obtain student per- 
ceptions about: (1) how much the institution has influenced their progress 
or change in some potential areas of change, and (2) how significant is 
progress in each of those areas of change. 
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Procedures for an EXITING-STUDENT or FORMER-STUDENT Questionnaire 



Alternative #1 



In the modified version of Wilson's procedure presented below, "agents of 
change" are not identified specifically. Instead, spaces are provided for 
the user of the instrument to insert the "agents of change" he or she is 
Interested in studying. The following list suggests some "agents of change" 
that might be inserted: 

- courses 

- faculty 

T -fellow students 

- general maturity 

- work experience 

- library staff and facilities 

- cultural events sponsored by the institution 

- student union staff and facilities 

- athletic events and facilities ^' ^ 

- social organizations affiliated with the institution 

- educational forums, workshops, etc. 

- experiences in the local community 



In addition to the user pre-specifying certain "agents of change," another 
option that might be considered is to leave one of the boxes open so the 
student could insert his or her significant "agents of change." 



It also should be noted that while a list of seven "types of change" has been 
suggested in the questionnaire format below, it can be modified to meet the 
purposes of the study. 
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Alternative #2; 



It should be noted that rather than having a student focus on multiple agents 
of change, as is the case in the previous alternative, this alternative pro- 
cedure, which is presented on the next page, asks a student to focus on only 
one change agent— the institution . 
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1. There are many reasons for pursuing education, some of which are listed below. In thinking over your edu- 
cational experience, how much do you think this Institution contributed to your progress In each area? 
(Check the appropriate box to the right of each category.) 







No 

Progress 
(1) 


Little 
Progress 
(2) 


Moderate 
Progress 
(3) 


Much 
Progress 
(4) 


Very Much 
Progress 
(5) 


A. 


Intellectual Growth: Your ability to understand 
and use concepts and principles from several broad 
areas of learning. 












B. 


Social Growth: Your understanding of other people 
and their views; your experience In relating to 
others. 












C. 


Aesthetic and Cultural Growth: Your awareness and 
appreciation of the literature, music, art. and 
drama of your own culture and of others. 












D. 


Educational Growth: Your understanding of a 
particular field of knowledge; your preparation 
for further education. 












E. 


Vocational and Professional Growth: Your prepa- 
ration for employment in a particular vocational 
or professional area. 












F. 


Personal Growth: Your development of attitudes, 
values, beliefs, and a particular philosophy 
of* life; your understanding and acceptance of 
yourself as a person; your ability to be 
realistic and adaptable and to make decisions 
about your own future. 













2. How Important Is that progress to you? (Check the appropriate box to the right of each category.) 





No 
Progress 
(1) 


Little 
Progress 
(2) 


Moderate 
Progress 
(3) 


Much 
Progress 
(4) 


Very Much 
Progress 
(5) 


A. 


Intellectual Growth: Your ability to understand 
and use concepts and principles from several broad 
areas of learning. 












B. 


Social Growth: Your understanding of other people 
and their views; your experience in relating to 
others. 












C. 


Aesthetic and Cultural Growth: Your awareness and 
appreciation of the literature, music, art. and 
drama of your own culture and of others. 












0. 


Educational Growth: Your understanding of a 
particular field of knowledge; your preparation 
for further education. 












E. 


Vocational and Professional Growth: Your prepa- 
ration for employment in a particular vocational 
or professional area. 












F. 


Personal Growth: Your development of attitudes, 
values, beliefs, and a particular philosophy 
of life; your understanding and acceptance of 
yourself as a person; your ability to be 
realistic and adaptable and to make decisions 
about your own future. 
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B. Student Educational Career Development Outcomes 



B-l Highest degree or certificate planned 

B-2 Students enrolled in an organized educational 

activity for no credits 
B-3 Program completers during a certain time period 
B-4 Program completers who entered as transfer students 
B-5 Degrees and certificates earned by an entering 

class of students 
B-6 Time to program completion for a graduating class 
B-7 Time to program completion for an entering class 
B-8 Educational program dropouts 

B-9 Students seeking additional degrees and certificates 
B-10 Students working toward and receiving another 

degree or certificate 
B-11 Student ability to transfer credits 
B-12 Level of achievement of former students 

in another institution 



ERIC 



50 

41 



NATIONAL CENTER FOR HIGHER EDUCATION MANAGEMENT SYSTEMS 
Outcome Measures and Procedures Manual 



B-1 



MEASURE 
NUMBER 



EASURE NAME 



Highest degree or certificate planned 



EFINITION 



Number and percentage of students and/or former students identifying a 
certain degree or certificate as the highest planned 



ATA SOURCES 



Current Students, Exiting Students, Former Students 



»ROCEDIJRES 



Administration of a survey questionnaire 



:OMMENTS 



This outcome measure is identified as a potential measure of a person's 
Educati onal Aspi rations (1.4.2.02) in the NCHEMS Inventory of Higher Education 
Outcome variables and Measures— see Appendix A. 

This measure can be used as an indicator of the educational or competency 
level desired and valued by students (student educational aspirations). 
If collected from students at entrance, in progress, at exit, and after they 
have left the institution (for example, two years later), the measure can 
provide information about changes in the educational aspirations of students. 
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ACQUISITION PROCEDURES FOR OUTCOME MEASURE B-1 



Data for outcome measure B-1 can be obtained using a survey questionnaire 
completed by students c rently enrolled in the institution, students as 
they are leaving, and former students sometime after they have left. It 
should be noted that the questionnaire items developed for obtaining data 
for this measure are comparable to those used in the American Council on 
Education's longitudinal follow-up study of college students by Astin and 
Panos (196^). As a result, comparisons can be made between the results of 
the ACE follow-up study and the results derived from the use of these items. 

Similar items are included in the college entrance batteries of the American 
College Testing Program and the College Entrance Examination Board. This 
may mean that information already is available for entering freshmen. 
Furthermore, both organizations annually develop various types of norms for 
such variables. 

Procedures for CURRENT-, EXITING-, and/or FORMER-STUDENT Questionnaires 

The following items are appropriate for inclusion in questionnaires designed 
to obtain outcome measure B-1 from CURRENT STUDENTS, EXITING STUDENTS 
(program completers and noncompl eters ) , and/or FORMER STUDENTS (graduates 
and nongraduates ) . The second item, which asks the respondent to identify 
when he or she plans to complete the highest degree or certificate, should 
be considered optional. 
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Measure B-1 : CURRENT-, EXITING,- and/or FORMER-STUDENT Questionnaire 



1. What is the highest deqree or certificate vou eventuallv plan to 
complete? (Please check one.) 


(1) 


Certificate 




(2) 


Diploma (Other than those listed below) 


(3) 


Associate degree 




(4) 


Bachelor's degree 




(5) 


Master's degree ' 




(6) 


Professional degree (Include only dentistry, medicine, 
optometry, osteopathy, podiatry, veterinary medicine, 
law, and theology) 


, (7) 


Doctorate (e.g., Ph.D., Ed.D., D.B.A.) 


(8) 


Other (Please specify) 


(9) 


Undecided 




2. When do you expect to attain your planned highest level of education? 
(Please check one.) 


(1) 


I have already obtained it 


(2) 


This year (1975) ^ 




(3) 


1976 




(4) 


1977 [ 




(5) 
(6) 
(7) 


1978 I 

1979 

1980 


NOTE: When using this item, 
substitute the number 
of years ahead of the 
I base year. 


(8) 


After 1980 ^ 




(9) 


Not sure 
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If it is desirable to know the major field of study that w111 be associated 



with the highest degree a respondent plans to complete, the following alter- 
native item can be Inserted in place of the first item presented above. Note: 
this item w111 need to be accompanied by a coded 11st of majors. Appendix B 
presents two lists of occupations and educational programs that can be used 
by students to code their major. The first 11st has been developed by NCHEMS 
for use in the "Student Outcomes Questionnaire for Program Completers" being 
implemented as part of the NCHEMS Information Exchange Procedures project. 
The second list of majors has been developed and used by the American College 
Testing Program. If your institution participates in the ACT program, use of 
the ACT list of majors would allow comparisons of student choices at different 
points in time. 



I.a. 



What is 
to comp 

(1 

(2 

(3 



_(4 
.(5 
(6 



.(7 
-(8 
_(9 



the highest degree or certificate you eventually plan 
ete? (Please check one.) 

Certificate 

Diploma (Other than those listed below) 
Associate degree 
Bachelor's degree 
Master's degree 

Professional degree (Includes only dentistry, medicine, 
optometry, osteopathy, podiatry, veterinary medicine, 
law, and theology) 

Doctor's degree (e.g., Ph.D., Ed.D., D.B.A.) 

Other (Please specify) 

Undecided 
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b. From the list that appears on page , please select the entry that most 

closely corresponds to the field of study for the degree or certificate 
above and write its 3-digit code number in the space below. 



Field of study: 
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B-2 

MEASURE 
NUMBER 



■ASURE NAME 



students enrolled in an organized educational activity 
for no credit 



EFINITION 



Number and percentage of students enrolled in organized educational 
activities for no credit within a certain period of time 



ATA SOURCES 



Current Students, Exiting Students, Former Students 



'ROCEDIJRES 



Search of institutional records/administration of a survey questionnaire 



:OHHENTS 



This outcome measure is identified as a potential proxy measure of a student's 
Intellectual Disposition (1.1.3.01) in the NCHEMS Inventory of Higher Education 
Outcome Variables and Measures—see Appendix A. 
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ACQUISITION PROCEDURES FOR OUTCOME MEASURE B-2 



Two alternative procedures have been developed for obtaining data for outcome 
measure B-2. The first alternative calls for the use of Institutional records; 
the second Involves the use of a survey questionnaire. The procedure for using 
Institutional records permits data collection pertaining only to current stu- 
dents, while the survey questionnaire procedure can be used to obtain data 
for this measure from current students, exiting students, or former students. 

Procedure for Use of Institutional Records 

The procedure for using Institutional records does not provide a means for 
learning about the non-credit-producing educational -activities current students 
participate In outside the Institution. If this limitation Is not a concern, 
the following procedural steps may be useful. 

1. Determine the sample of current students to be studied 
(such as lower division and upper division students seeking 
a bachelor's degree In a particular major program of stucty). 

2. For each student In the selected sample. Identify from the 
student enrollment records whether a student has taken a 
course (credit-producing or non-credit-producing) for no 
credit during at least one of the two most recent academic 
terms (summer or special academic sessions Included). Stu- 
dents who enrolled In an organized educational activity for 
no credit should be counted regardless of whether they com- 
pleted the course. 
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3. For each student who took a course for no^^edit, determine if 
the student was: 

a. enrolled in a course that was offered for credit, or 

b. enrolled in a course that was not offered for credit. 

4. For a descriptive summary of the data, calculate the number and 
percentage of current students taking courses (both credit* 
producing and non-credit-producing) for no credit. 

Procedure for a CURRENT-, EXITING-, or FORMER-STUDENT Questionnaire 

The following questionnaire item developed for obtaining data for outcome 
measure B-2 is intended to identify (1) those current, exiting, or former 
students who have participated in organized educational activities for no 
credit, and (2) who sponsored the activities. 
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1. Have you participated during the last six months* in any organized 
educational activity that did not give you credit that could be applied 
to a college degree? 

(1) Yes (GO TO QUESTION 2) 

{2) No (SKIP TO QUESTION ) 



2. Which of the following institutions or organizations sponsored the educa- 
tional activity (or activities) in which you participated? (CHECK ALL 
THAT APPLY) 

0) tinsert Name of Institution administering this 

questionnaire] 

(2) A college other than [Name of Institution] 

i^) A local institution (for example a church) or a local 

agency (for example the YMCA or the city recreation 
department) 

{^) Your employer 

(5) Other (Please specify) 



3. The type(s) of subject area(s) emphasized were 



*Note that this period of time can be modified, depending on 
the purpose of the study. 
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B-3 

MEASURE. 
NUMBER 



lASURE NAME 



Program completers during a certain time period 



EFINITION 



The number and percentage of students completing a degree or certificate 
during a cert2|in period of time; by student program 



ATA SOURCES 



Institutional Student Records 



•ROCEDURES 



Search of Institutional Records 



;OMMENTS 



This outcome measure is identified as a potential measure of a student's Academic 
Preparation (1.4.1.01) in the NCHEMS Inventory of Higher Education Outcome 
Variables and Measures— see Appendix A. 
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ACQUISITION PROCEDURES FOR OUTCOME MEASURE B-3 



The procedure recommended for obtaining data for outcome measure B-3 is 
straight forward and requires the use of institutional records. 

Procedure for Use of Institutional Records 

1. For a specific period of time (such as a fiscal year)t identify: 

(1) a11 students who have received a degree or certificate, and 

(2) a11 students who were eligible to receive a degree or cer- 
tificate but did not complete the necessary administrative steps 
to actually receive the award. Many institutions may not have 
any degree or certificate completers of this second type or may 
not be able to identify those they do have. 

2. For each completer, identify the type of degree or certificate 
he or she received (or was eligible to receive): 

Certificate 

Diploma (Other than those listed below) 
Associate degree 
Bachelor's degree 
Master's degree 

Professional degree (Includes only dentistry, medicine, 
optometry, osteopathy, podiatry, veterinary medicine, 
law, and theology) 

Doctorate (e.g., Ph.D., Ed.D., D.B.A.) 

Other (Please specify) ^ 

Undecided 

3. Next, identify the student program (bachelor's degree in genetics, 
a certificate in welding, and so forth) associated with the degree 
or certificate received by each program completer. The appropri- 
ate student category for each student should be determined 
according to his or her major at the time of graduation. You can 

GO 
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use one of the lists cf occupations and educational programs 
presented In Appendix B or the Higher Education General Infor- 
mation Survey (HEGIS) discipline 11st In Appendix C to code the 
student programs Identified. Although the HEGIS 11st designates 
disciplines, for purposes of this procedure the list can be used 
to designate studient programs when appropriate. 
Finally, Identify each program completer's status when he or she 
entered the Institution: 

a. New Undergraduate Student 

b. Transfer Undergraduate. Student 

c. New Graduate Student 

d. Transfer Graduate Student 

For a descriptive summary of the data, calculate the number and 
percentage of students completing a degree or certificate during 
the designated period of time, by type of student program and by 
student status at entrance. 
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B-4 



MEASURE 
NUMBER 



lEASURE NAME 



Program completers who entered as transfer students 



lEFINITION 



Number and percentage of students who entered as transfer students earning a 
degree or certificate during ascertain period of time by status at entrance 



)ATA SOURCES 



Institutional Student Records 



PROCEDURES 



Search of Institutional Records 



COMMENTS 



This outcome measure Is identified as a potential measure of Academic Preparation 
(1.4.1.01) in the NCHEMS Inventory of Higher Education Outcome Variables and 
Measures— see Appendix A. 
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ACQUISITION PROCEDURES FOR OUTCOME MEASURE B-4 



The procedure developed for obtaining data for outcome measure B-3 should 
be used to obtain the data for this outcome measure, B-4. 
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B-5 



MEASURE 
NUMBER 



1EASURE NAME 



Degrees and certificates earned by an entering class of students 



)EFINITION 



Number and percentage of students in a designated entering class who have earned a 
degree or certificate from the institution within a certain period of time, by type 
of degree or certificate, student status at entrance, and student program (field 
of study) 



DATA SOURCES 



Institutional Records of a Designated Entering Class of Students (e.g., the 
entering class of 1970) 



PROCEDURES 



Search of Institutional Records 



COMMENTS 



This outcome measure is identified as a potential measure of Academic Preparation 
(1.4.1.01) in the NCHEMS Inventory of Higher Education Outcome Variables and 
Measures— see Appendix A. 

Measures B-5 and B-3 differ in that B-5 identifies the success an entering class 
has had in completing their degree or certificate programs whereas B-3 identifies 
those students earning a degree or certificate during a given period of time with 
no consideration of when they entered the institution. 
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ACQUISITION PROCEDURES FOR OUTCOME MEASURE B-5 

The procedures developed for acquiring data for outcome measure B-5 are 
based on the use of institutional records. It should be noted that in 
addit'ion to being appropriate for identifying the number and percentage of 
students in an entering class who have graduated or are expected to graduate 
In a certain period of time, the procedures also identify those students in 
an entering class (1) who are currently enrolled in the institution and 
. (2) who have left the institution without receiving a degree or^certificate. 

Procedure for Use of Institutional Records 

1. Select the entering class to be studied. Categorize students 

in the entering class in terms of their student status at entrance: 

a. New Undergraduate Students 

b. Transfer Undergraduate Students 

c. New Graduate Students 

d. Transfer Graduate Students 

2. Determine the cut-off date to be used in obtaining data for 
outcome measure B-5. 

3. Examine student records for the selected entering class and 
identify: 

a. Those students who have earned a degree or certificate 
by cut-off date. Students who are eligible to receive 
a degree or certificate but who have not completed the 
necessary administrative steps to actually receive the 
award should be included. 
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b. Those students who are currently enrolled in the Institution. 

c. Those students who left the Institution prior to completion of 
a degree or certificate. (This group of students would Include 
those who have left permanently and those who may return.) 

Identify the type of degree or certificate earned by each program 

completer: 

Certificate i 
Diploma (Other than those listed below) 
Associate degree 
Bachelor's degree 
Master's degree 

Professional degree (Includes only dentistry, medicine, 
optometry, osteopathy, podiatry, veterinary medicine, 
law, and theology) 

Doctorate (e.g*, Ph.D., Ed. D., D.B.A.) 

Other (Please specify) 

Undecided 

Next Identify the student major program (bachelor's degree in genetics, 
a certificate In welding, and so forth) for each completer. The 
appropriate student major program category for each studeht should 
be determined according to his or her major at the time of graduation. 
You can use one of the lists of occupations and educational programs 
presented In Appendix B or the Higher Education General Information 
Survey (HEGIS) discipline list In Appendix C to code the student 
programs Identified. Although the HEGIS list designates disciplines, 
for purposes of this procedure the list can be used to designate 
student programs when appropriate. 

For a descriptive summary of the data, calculate the number and 
percentage of students In the selected entering class who have earned 
a degree or certificate within the designated period of time, by 
their status at entrance and their major at graduation. 
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B-6 



MEASURE 
NUMBER 



EASURE NAME 



Time to program completion for a graduating class 



EFINITION 



Amount of time it takes a student in a particular graduating class to earn a 
degree or certificate, by degree or certificate type, student major program, 
and student status at entrance 



)ATA SOURCES 



Institutional Student Records 



PROCEDURES 



Search of Institutional Records 



COMMENTS 



This outcome measure is identified as a potential measure of Academic Preparation 
(1.4.1.01) in the NCHEMS Inventory of Higher Education Outcome Variables and 
Measures— see Appendix A. 
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ACQUISITION PROCEDURES FOR OUTCOME MEASURE B-6 

The procedure reconmended for obtaining data for outcome measure B-6, "Amount 
of time it takes a student in a particular graduating class to earn a degree 
or certificate," requires the use of student institutional records. It is 
important to note that this procedure does not distinguish graduates who 
have been enrolled on a continuous basis from those who have been enrolled 
on an intermittent basis. Also, the procedure does not delineate graduates 
who have always been full-time students from those who, at one time or another, 
have been part-time enrollees. If these distinctions are important, the 
following steps will need to be modified accordingly. 

Proced ur e for Use of Institutional Records 

1. Select the graduating class to be studied. 

2. Examine institutional records for students in the graduating class 
and identify student status at entrance for each student: 

a. New Undergraduate Student 

b. Transfer Undergraduate Student 

c. New Graduate Student 

d. Transfer Graduate Student 

3. Identify for each student the total number of months elapsed from 
entry date to graduation date and/or the total number of terms 
enrolled (summer terms and special sessions Inlcuded) from entry 
date to graduation date. - ^ 
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4. Determine for each student In the study: 

a. Type of degree or certificate earned: 
Certificate 

Diploma (Other than those listed below) 
Associate degree 
Bachelor's degree 
Master's degree 

Professional degree (Includes only dentistry, medicine, 
optometry, osteopathy, podiatry, veterinary medicine, 
law, and theology) 

Doctorate (e.g., Ph.D., Ed.D., D.B.A.) 

Other (Please specify )_ 

Undecided 

b. Major program at graduation: 

Appendix B presents alternative lists of occupations and 
educational programs that can be used to code each 
graduating student's major program. 

5. Data now are available to calculate the median or mean number of 
months elapsed and/or the median or mean number of terms enrolled by: 

a. Type of degree or certificate earned 

b. Student major program at graduation 

c. Student status at entrance 



id 
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B-7 



MEASURE 
NUMBER 



EASURE NAME 



Time to program completion for an entering class 



EFINITION 



Amount of time it takes a student in a particular entering class to earn a degree 
or certificate, by degree or certificate type, student major program, and 
student status at entrance 



lATA SOURCES 



Institutional Student Records 



PROCEDURES 



Search of Institutional Records 



:OMMENTS 



This outcome measure is identified as a potential measure of Academic Preparation 
(1.4.1.01) in the NCHEMS Inventory of Higher Education Outcome Variables and 
Measures— see Appendix A. 

The procedures suggested for obtaining data for this measure allow as the basic 
unit of measurement either total number of months elapsed from entry date to 
graduation or total number of academic terms enrolled in that period of time. 



er|c 



70 

65 



ACQUISITION PROCEDURES FOR OUTCOME MEASURE B-7 



The procedure developed for obtaining data for outcome measure B*-7, "Amount 
of time It takes a student In a particular entering class to earn a degree 
or certificate," involves the use of student institutional records. It is 
important to note that this procedure does not distinguish graduates who have 
been enrolled on a continuous basis from those who have been enrolled on an 
intermittent basis. Also, the procedure does not delineate graduates who 
have always been fu11--time students from those who, at one time or another, 
have been part-time enroHees. If these distinctions are important, the 
following steps will need to be modified accordingly. 

Procedure for Use of Insitutitutional Records 

- 1. Select entering class to be studied (for example, all new 
undergraduate students who entered Fa11 term of 1970). 
2. Examine institutional records for the students in the 
designated entering class: 

a. Identify those students who have graduated or are 



expected to graduate by the specified cut-off date 



(such as Spring 1975). 



b. 



Identify for each student identified in step a: 



(1) 



total number of months elapsed from entry date to 



graduation date, and/or 



(2) 



total number of terms enrolled (summer terms and special 
sessions included) from entry date to graduation date. 
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c. Determine for each student in the study: 

(1) Student status at entrance: 
New Undergraduate Student 
Transfer Undergraduate Student 
New Graduate Student 
Transfer Graduate Student 

(2) Type of degree certificate earned: 
Certificate 

Diploma (Other than those listed below) 
Associate degree 
Bachelor's degree 
Master's degree 

Professional degr^ee (Includes only dentistry, medicine, 
optometry, osteopathy, podiatry, veterinary medicine, 
law, and theology) 

Doctorate (e.g., Ph.D., Ed.D., D.B.A.) 

Other (Please specif y)^ 

Undecided 

(3) Major program at graduation: 

Appendix B presents alternative lists of occupations and 
educational programs that can be used to code each student's 
major program at time of graduation. 
3. Data now are available to calculate the median or mean number of 
months elapsed and/or the median or mean number of terms enrolled 
for each graduating student in the designated entering class by: 

a. Student status at entrance 

b. Type of degree or certificate earned 

c. Student major program at graduation 
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B-8 

MEASURE 

NUMBER 



lEASURE NANE 



Educational program dropouts 



EFINITION 



The number and percentage of full-time students in degree or certificate programs 
who left the institution prior to completion of their -program, by student level 



and exit status 



)ATA SOURCES 



Former full-time students who were seeking a degree or certificate but 
"dropped out" of the institution 



PROCEDURES 



Search of Institutional Records 



COMMENTS 



This outcome measure is identified as a potential measure of Academic Preparation 
(1.4.1.01) in the NCHEMS Inventory of Higher Education Outcome Variables and 
Measures— see Appendix A. 

The procedures that follow are not applicable to students enrolled in certificate 
programs that are conducted for periods of time not synonymous with regular 
academic sessions (e.g., a special five-week certificate program). 

The information obtained for this measure should be reviewed along with information 
about the number of continuing and readmitted students. In combination, 
these measures can provide general information about the pattern of student 
attendance at the institution over a short period of time. 

The procedure for this measure can be used to identify the group of former students 
who should be surveyed regarding their reasons for leaving the institution before 
completing their program. 

NCHEMS Information Exchange Procedures Outcomes Study Procedures (Technical Report 
No. 66) contains a slightly modified version of the data acquisition procedures 
recommended for this outcome measure. 
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ACQUISITION PROCEDURES FOR OUTCOME MEASURE B-8 



The procedure recommended for obtaining data for outcome measure B-8 
requires the use of Institutional records. An advantage of the proce- 
dure Is that It establishes a defined period of time that determines 
when a student should be classified as a dropout."^ 

Procedure for Use of Institutional Records 

1. Identify a11 students In degree and certificate programs 
who were enrolled full-time at the Institution at one of 
the following polnt(s) In time prior to the current Fall term: 

a. The previous semester If the Institution Is on a 
semester system with no summer session (for example, 
the previous semester); 

b. For at least one of the previous two terms If the 
Institution Is on a semester system In which a summer 
session Is a regular term (for example, the previous 
Summer semester or Spring semester); If the summer 
session Is divided Into a number or parts, attendance 
during one part constitutes enrollment for the term; 

c. The previous semester If the Institution Is on a 4-1-4 
system; ^ 

d. For at least one of the previous two terms If the Insti- 
tution is on a trimester system; 

"^This time period can be varied depending upon the Interests of the 
user of this procedure. 74 
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e. The previous quarter if the institution is on a quarter 
system with three quarters and no sumner sessions (for 
example, the previous Spring quarter); 

f. For at least one of the two previous terms if the institution 
is on a quarter system with four quarters or three quarters 
and a sumner session where the sumner session is considered 

a regular term (for example, the previous Sumner or Spring 
quarter); if the sumner is divided into a number of parts, 
attendance during one part constitutes enrollment for the term. 

For each student identified above, identify those who did not 

complete a program prior to the current Fall term. 

For the program noncompleters identified in step 2, determine those 

who are not enrolled at the institution in the current Fall term. 

4)eterfni nation of enrollment should be made as of the census date 

for the Fall term at the institution. 

For each of the students identified in step 3, determine his or her 
status at the institution as of the end of the last term he or she 
was enrolled: 

a. In Good Standing 

b. Not in Good Standing 

(1) Academically Dropped or Suspended 

(2) Other 

For each of the students identified in step 3, determine his or her 
student level as of the end of the last term he or she was enrolled: 

a. Lower Division 

b. Upper Division 

c. Graduate 
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Data should now be available to calculate the number and percentage 
of full -time students in degree or certificate programs who left 
the institution during the designated time period prior to completion 
of their program, by student level and status at termination. 
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B-9 



MEASURE 
NUMBER 



lASURE NAME 



students seeking additional degrees and certificates 



EFINITION 



Number and percentage of exiting or former students who have been admitted 
or are seeking admission to another educational program which when completed 
will result in a degree or certificate, by type of degree or certificate and 
by student major program 



ATA SOURCES 



Exiting Students, Former Students 



ROCEDURES 



Administration of a survey questionnaire 



:0H11ENTS 



This outcome measure is identified as a potential measure of Educational Aspi rations 

(1.4.2.02) in the NCHEMS Inventory of Higher Education Outcome Variables and 

Measures— see Appendix A. . 

The procedure for determining this measure has been developed so that outcome 
measure B-10, "Number and percentage of students working toward or receiving 
another degree or certificate after a certain period of time," is obtained at the 
same time. 
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ACQUISITION PROCEDURES FOR OUTCOME MEASURE B-9 



Since this outcome measure, B-9, and outcome measure B-10 that follows 
("Students working toward and receiving another degree or certificate") are 
likely to be desired simultaneously, procedures involving the use of a 
survey questionnaire have been developed to obtain data for both outcome 
measures at the same time. Since data for the two outcome measures can be 
obtained for either exiting students or former students, two sets of ques- 
tionnaire items have been developed. 

Procedures for an EXITING-STUDENT Questionnaire 

Item 2.b below requires the use of a coded list of student major programs. 
Appendix B presents alternative lists of occupations and educational programs 
that students can use to code their major. 

Procedures for a FORMER-STUDENT Questionnaire 

Two alternative procedures have been developed for inclusion in a questionnaire 
for former students. The first alternative is more detailed and may be more 
appropriate in a former- student questionnaire sent to graduates of the 
institution. The second alternative procedure is designed to obtain more 
general information about a former student's educational plans and it may 
be more appropriate for inclusion in a questionnaire sent to former students 
who have "dropped out ." 

Item 2.b. below requires the use of a coded list of student major programs. 
Appendix B presents alternative lists of occupations and educational programs 
that students can use to code their maijor. 
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1. Have you applied for admission to one or more educational programs 
(either here or at another school) that would result in your 
earning another degree or certificate? (PLEASE CHECK ONE) 

(1) Yes, I have applied (60 TO QUESTION 2) 



_(2) No, but I intend to apply within the next year 
(SKIP TO QUESTION ) 

_(3) No, and I do not intend to apply within the next year 
(SKIP TO QUESTION ) ^ 



2. a. 



What kind of degree or certificate would result from the program(s) 
to which you have applied? (PLEASE CHECK ONE) 

(1) Certificate 

.(2) Diploma (Other than those listed below) 

(3) Associate degree 

(4) Bachelor's degree 

(5) Master's degree 



_(6) Professional degree (Includes only dentistry, medicine, 
optometry, osteopathy, podiatry, veterinary medicine, 
law, and theology) 

_(7) 'Doctorate (e.g., Ph.D., Ed.D. * D.B.A.) 
_(8) Other (Please specify) 



b. From the list that appears on page , please select the entry that 
most closely corresponds to the fiel¥of study you plan to pursue and 
write Its 3-digit code number in the space below: 

Field of study: | | | i 
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Alternative #1 : 



1. , Since leaving [Name of Institution], have you been admitted to another 
educational program (either here or at another school) which when 
completed would result in a degree or certificate? (PLEASE CHECK ONE) 

(1) Yes (60 TO QUESTION 2) 

{2) No, but I have applied for admission to another educational 

program. (60 TO QUESTION 2) 

{3) No, I was not admitted although I applied. (60 TO QUESTION 2) 

{^) No, I did not apply to any other educational program. (SKIP 

TO QUESTION ) 



2.a. What kind of degree(s) or certificate(s) were you (or are you) 

seeking? (Please write in the space below a 1 if you have sought a 
degree or certificate but have not been awarded it, and a Z_ if you 
have already been awarded it.) 

0) Certificate 

{2) Diploma (Other than those listed below) 

{3) Associate degree 

{A) Bachelor's degree 

{5) Master's degree 

{6) Professional-degree (Ii?€ludes only dentistry, medicine, 

optometry, osteopathy, podiatry, veterinary medicine, 
law, and theology) 

, (7) Doctorate (e.g., Ph.D., Ed.D., D.B.A.) 

{B) Other (Please specify y 



b. From the list that appears on page , please select the entry that 
most closely corresponds to the fieTffof study you most recently 
pursued (or are pursuing now) and write its 3-digit number in the 
space below: 

Field of study: | i I | 
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Alternative #2: 



1. Since leaving [Name of Institution], have you applied for admission 
to any other educational program (either here or at another school) 
that would result in your earning a degree or certificate? 

(1) Yes, I hafe applied and have been admitted. 

(^) Yes, I have applied but have not been admitted. 

(3) No, but I intend to apply within the next year. 

(4) No, and I do not intend to apply within the next year. 
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B-10 



MEASURE 
NUMBER 



EASURE NAME students working toward and receiving another degree or 
■ ' certificate 



EFINITION 



Number and percentage of exiting or former students who are working toward or have 
received another degree or certificate, by degree/diploma/certificate type and by 
student major program 



\TA SOURCES 1 




Exiting Students, Former Students - 




ROCEDURES | 




Administration of a Survey Questionnaire 





OMMENTS 



A 3S a potential measure of Education Aspirations 

(1.4.2.02) In the NCHEMS Inventory of Higher Education Outcome Variables and 

Measures— see Appendix A. 
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ACQUISITION PROCEDURES FOR OUTCOME MEASURE B-10 

The procedure developed for obtaining data for outcome measure B-9 should 
be used to obtain the data necessary to derive this outcome measure, B-10. 



5^ 
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B-n 



^MEASURE 
NUMBER 



lASLURE NAME 



student ability to transfer credits 



EFINITION 



Number and percentage of exiting and/or former students who have successfully 
transferred credits to another school 



ATA SOURCES 

Exiting Students, Former Students 



>ROCEDURES 



Administration of a Survey Questionnaire 



:OlflENTS 



This measure and outcome measure B-12 may be useful as indicators of the 
success of former students who have* enrolled in another institution. 

If the procedures for this measure are used in an EXITING-STUDENT Questionnaire, 
it would be appropriate to include them in the section of the questionnaire th4t 
contains the exiting students' responses concerning whether they have been 
admitted or are seeking admission to another program. (See outcome measures 
B-9 and B-10.) 

I 
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ACQUISITION PROCEDURES FOR OUTCOME MEASURE B-11 



The procedures developed for identifying student success in transferring 
credits to another institution require the use of a survey questionnaire. 
The first questionnaire item identifies whether the respondent attempted 
to transfer any credits. The second question identifies reasons why 
respondents were not successful in transferring credits. 

It should be noted that this sequence of questions usually would be asked 
after it was determined that the respondent had been admitted to or was 
attending another school. Also, it is assumed that the school to which 
the respondent has transferred will be identified by the respondent in 
the questionnaire. 
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1. Did you try to transfer credits from [Name of Institution] when you 
were admitted to your new program? (PLEASE CHECK ONE) 

(1) Yes, and they were all accepted. (SKIP TO QUESTION ) 

(2) Yes, but some credits wtie not accepted. (GO TO QUESTION 2) 

(3) Yes, but none of the credits were accepted. (GO TO QUESTION 2) 

i^) No. (SKIP TO QUESTION ) 

2. What was the major reason that the credits were not accepted? 
(PLEASE CHECKlify 

(1) Don't know 

(2) No comparable course 

{3) Switched fields of study 

_(4) Limit on transfer of credits 

i^) The institution does not accept transfer credits 

{6) Other (Please explain) 
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B-12 



MEASURE 
NUMBER 



EASURE NAME 



Level of achievement of former students in another institution 



EFINITION f 



Number and percentage of former Students achieving a certain grade point 
average in another institution 



ATA SOURCES 



Former Students 



>ROCEDURES 



Administration of a Survey Questionnaire 



:OMMENTS 



This outcome measure is identified as a potential measure of Academic Preparation 
(1 ^.1.01) in the NCHEMS Inventory of Higher Education Outcome Variables and 
Meaaisres —see Appendix A. 



This measure and outcome measure B-11 could be useful also as indicators of the 
success of former students who have enrolled in another institution. 



ACQUISITION PROCEDURES FOR OUTCOME MEASURE B-12 

the success former students have In achieving an acceptable grade point 
average at another shcool is often determined from grade reports sent by 
the schools in which the former students enroll. However, in many instances 
such reports are not available. As a result, the following questionnaire 
items have been developed to obtain data for outcome measure B-12 using a 
survey questionnaire for former students (graduates and nongraduates). 

Procedures for a FORMER-STUDENT Questionnaire 

[SEE FOLLOWING PAGE] 
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1. How many college credits have you earned since you left [Name of 
Institution]? 

a. Undergraduate Credits 

None 

Less than 10 sem. hrs. (15 qtr. hrs.) 
10-19 sem. hrs. (15-29 qtr. hrs.) 
20-29 sem. hrs. (30-44 qtr. hrs.) 
30-39 sem. hrs. (45-59 qtr. hrs.) 
40-49 sem. hrs. (60-74 qtr. hrs.) 
50 sem. hrs. or more (75 qtr. hrs. or more) 



b. Graduate Credits 
None 

Less than 10 sem. hrs. (15 qtr. hrs.) 
10-19 sem. hrs. (15-29 qtr. hrs.) 
20-29 sem. hrs. (30-44 qtr. hrs.) 
30-39 sem. hrs. (45-,594qtr. hrs.) 
40-49 sem. hrs. (60-74 qtr. hrs.) 
50 sem. hrs. or more (75 qtr. hrs. or more) 




.0) 
.(2) 

-(3) 
1(4) 
.(5) 
1(6) 
.(7) 



2. What grade point average have you 
(A 4.00 G.P.A. is equivalent to a 

a. Undergraduate G.P.A. 

{1) Less than 1.00 

(2) 1.00 - 1.49 

l3) 1.50 - 1.99 

(4) 2.00 - 2.49 
(5) 2.50 - 2.99 

(6) 3.00 - 3.49 

(7) 3.50 - 3.99 

{8) 4.00 

(9) Not applicable 



ined while earning these credits? 
ight "A" average.) 

b. Graduate G.P.A. 

il) Less than 1.00 
2) 1.00 - 1.49 
3) 1.50 - 1.99 

(4) 2.00 - 2.49 

(5) 2.50 - 2.99 

{6) 3.00 - 3.49 

{7} 3.50 - 3.99 

. {8) 4.00 

(9) Not applicable 
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student Educational Satisfaction Outcomes 

C-1 Student satisfaction with overall educational experience 
C-2 Student satisfaction with vocational preparation 
C-3 Student satisfaction with knowledge and skills in the 
humanities 

C-4 Student satisfaction with critical thinking ability 
C-5 Student satisfaction with human relations skills 



\ 
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C-1 



MEASURE 
NUMBER 



.MEASURE NAME 



Student satisfaction with overall educational experience 



DEFINITION 



The responses of students to questionnaire Items measuring the degree of 
satisfaction with their overall college education experience 



DATA SOURCES 



Current Students, Exiting Students, Former Students 



I PROCEDURES 



Administration of a survey questionnaire 



COMMENTS 



This outcome measure is identified as a potential measure of Educational 
Satisfaction (1.4.2.03) in the NCHEMS Inventory of Higher Education Outcome 
Variables and Measures— see Appendix A. 
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ACQUISITION PROCEDURES FOR OUTCOME MEASURE C-1 



The procedure recommended for obtaining data for outcome measure C-1 
calls for the use of a survey questionnaire. The particular set of 
questions suggested is a modification of a series of questions developed 
by C. Robert Pace and his associates in the Higher Education Measurement 
and Evaluation Kit (1975) to determine students' "general satisfaction 
with college." 

Procedures for CURRENT-, EXITING-, or FORMER-STUDENT Questionnaire 

The following series of questions is appropriate for use in questionnaire 
surveys of an inititution's current students, exiting (program completers 
and noncompleters) students, and former students (graduates and nongraduates). 
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1. In general, how well do you like attending college? 

(}) I don't like It 

(2) I am more or less neutral about It 

(3) I like It 

{^) I am enthusiastic about It 

2. If you could start over again, would you still choose to attend 
(Name of Institution)? 

_(1) Definitely no 

{2) Probably no 

iZ) Probably yes 

{^) Definitely yes 

3. Regardless of any vocational benefit college may have for you at this 
point In time, do you think that being In college Is a very Important 
and beneficial experience? 

Jl) Definitely no Why? 

(2) Generally no 

(2) Generally yes 

{^) Definitely yes ■ 
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C-2 



MEASURE 
NUMBER 



1EASURE NAME 



Student satisfaction with vocational preparation 



)EFINITION 



The responses of students to questionnaire Items measuring the degree 
of satlsfactlxin with their vocational preparation 



DATA SOURCES 



Current Studerits, Exiting Students, Former Students 



PROCEDURES 



Administration of a survey questionnaire 



COMMENTS 



This outcome measure ts Identified as a potential measure of Vocational 
Preparation (1.4.1.02) In the NCHEMS Inventory of Higher Education Outcome 
variables and Measures— see Appendix A. 
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ACQUISITION PROCEDURES FOR OUTCOME MEASURE C-2 



The procedure recommended for assessing student satisfaction with vocational 
preparation requires the use of a survey questionnaire. The questionnaire 
items and format used to derive this measure are a modified version of the 
"Educational Benefits: Vocational Scale," which is included in the 
Higher Education Measurement and Evaluation Kit (1975) developed by C. Robert 
Pace and his associates at the Center for the Study of Evaluation, University 
of California, Los Angeles. The scale is intended to measure the extent to 
which students or former students feel their college work and experience 
have benefited them in achieving certain vocational preparation goals. 

Procedures for CURRENT-, EXITING-, or FORMER-STUDENT Questionnaire 

The following scale is appropriate for use in questionnaire surveys of 
current students, exiting students, and former students. 
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1. In thinking over your educational experiences at (Name of Institution)* 
to what extent do you think these experiences contributed to your 
progress In each of the following areas? 

Please check (/) the appropriate box to the right of esch category. 





(1) 
Very 
Little 


(2) 
Some 


.(3) 
Quite 
A. Bit 


(4) 

Very 

Much 


A. Background and special 1- 
^^^.^lation for further 
education In some pro- 
fessional, scientific or 
scholarly field. 










B. Basis for improved social 
and economic status. 










C. Vocab4Jlary, terminology, 
and-i^acts in various 
fieldis bf knowledge. 










D. Skills and techniques 
directly applicable to 
a job. 
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C-3 

MEASURE 
NUMBER 



fMEASURE NAME 



Student satisfaction w1 th knowl edge and skills In the 
humanities area 



DEFINITION 



The responses of students to questionnaire Items measuring the degree of 
satisfaction with their knowledge and skills In the humanities. Including 
philosophy, literature, the arts, and language 



DATA SOURCES 

Current Students, Exiting Students, Former Students 



PROCEDURES 

Administration of a survey questionnaire 

ICOMMENTS 



This outcome measure Is Identified as a potential measure of Specialized 
Knowledge (1.1.1.02) and Communi ca t1 on Ski 11 s (1.1.4.04) In NCMEMS Inventory 
of Higher Education Outcome Variables and Measures —see Appendix A. 
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ACQUISITION PROCEDURES FOR OUTCOME MEASURE C-3 



The procedure recopiended for assessing student satisfaction with knowledge 
and skills in the humanities area requires the use of a survey questionnaire. 
The questionnaire items and format used to derive this measure are a modified 
version of the "Educational Benefits: Humanistic Scale," which is presented 
in the Higher Education Measurement and Evaluation Kit developed by C. Robert 
Pace and his associates at the Center for the Study of Evaluation, University 
of California, Los Angeles (1975). The scale is Intended to measure the extent 
to which students or former students feel their college work and experience 
have benefited them in achieving certain goals related to knowledge and skills 
in the humanities. 

Procedures for CURRENT- > EXITING-, or FORMER-STUDENT Questionnaire 

The following scale is appropriate for use in questionnaire surveys of 
current students, exiting students (program completers and noncompl eters ) , 
and former students (graduates and nongraduates). 
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1. In thinking over your educational experiences at (Name of Institution), 
to what extent do you think these experiences contributed to your 
progress in each of the following areas? 

Please check (/) the appropriate box to the right of each category. 





(1) (2) (3) (4) 
Very Quite Very 
Little Some A Bit Much 


A. Awareness of different 
philosophies, cultures, 
and wavs of 1 i f e 










B. Broadened literary acquain- 
tance and appreciation. 










C. Aesthetic sensitivity; 
Appreciation and enjoyment 
of art, music, drama. 










D. Writing and speaking: 
clear, correct, 
effective communication. 
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C-4 

MEASURE 
NUMBER 



EASURE NAME 



Student satisfaction with critical thinking ability 



EFINITIt)N 



The responses of students to questionnaire items measuring the degree of 
satisfaction with their ability to formulate and analyze problems 



)ATA SOURCES 



Current Students, Exiting Students, Former Students 



PROCEDURES 



Administration of a survey questionnaire 



COMMENTS 



Jhis outcome measure is identified as a potential measure of Critic al 
Thinking and Reasoning Skills (1.1.2.02) in the NCHEMS Inventory of 
Higher Education Outcome Variables and Measures— see Appendix A 
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ACQUISITION PRQC|DyRES_FpR OUTCOME MEASURE C-4 

The procedure recomnended for assessing student satisfaction with critical 
thinking ability requires the use of a survey questionnaire. The questionnaire 
items and format used to derive this measure are a modified version of the 
•Educational Benefits: Critical Thinking Scale," which is presented in the 
Higher Education Measurement and Evaluation Kit developed by C. Robert Pace 
and his associates at the Center for the Study of Evaluation, University of 
California, Los Angeles (1975). The scale is intended to measure the extent 
to which students or former students feel their college work and experience 
have benefited them in achieving certain goals related to intellectual skills 
and abilities. 

Procedures for CURRENT-, EXITING-, or FORMER-STUDENT Questionnaire 

The following scale is appropriate for use in questionnaire surveys of 
current students, exiting students (program completers and noncompleters), 
and former students (graduates and nongraduates). 
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1. In thinking over your educational experiences at (Name of Institution), 
to what extent do you think these experiences contributed to your 
progress in each of the following areas? 



Please check (V) the appropriate box to the right of each category. 





(1) 
Very 
Little 


(2) 
Some 


(3) 
Quite 
A Bit 


(4) 

Very 

Much 


A . Reason! ng abi 1 i ty : recog- 
nlzlng assumptions, rfiaking 
logical Inferences, and 
reaching correct conclu- 
sions. 










B. Ability to see relationships, 
similarities, and differences 
between Ideas. 


: 


— 





— 


science, experimentation 
and theory. 










D. Critical thinking: ability 
to withhold judgment, raise 
questions, and examine 
contrary views. 










E. Quantitative thinking: 
inderstandlng concepts of 
probability, proportion, 
margin of error. 
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C-5 



MEASURE 
NUMBER 



ASURE NAME 



FINITION 



student satisfaction with human relations skills 



The responses of students to questionnaire items measuring the degree of 
satisfaction with their progress In achieving human relations skills 



TA SOURCES 



Current Students; Exiting Students, Former Students 



.OCEDURES 



Administration of a survey questionnaire 



IMMENTS 



This outcome measure is identified as a potential measure of Interperson al 
Participation (1.2.1.01) and Social Conscience (1.2.2.04) In the NcHCHS — 
inventory of Higher Education Outcome Variables and Measures— see Appendix A. 
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ACQUISITION PROCEDURES FOR OUTCOME MEASURE C-5 

The procedure recommended for assessing student satisfaction with human 
realtlons skills requires the use of a survey questionnaire. The questionnaire 
items and format used to derive this measure are a modified version of the 
"Educational Benefits: Human Relations Scale," which Is presented In the 
Higher Education Measurement and Evaluation Kit developed by C. Robert Pace 
and his associates at the Center for the Study of Evaluation, University of 
California, Los Angeles (1975). The scale Is Intended to measure the extent 
to which students or former students feel their college work and experience 
have benefited them In achieving certain human relations skill goals. 

Procedures for CURRENT-. EXITING-, or FORMER-STUDENT Questionnaire 

The following scale Is appropriate for use In questionnaire surveys of 
current students, exiting students (program completers and noncompleters), 
and former students (graduates and nongraduatas ) . 
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1. In thinking over your educational experiences at (Name of Institution), 
to what extent do you think these experiences contributed to your 
progress in each of the following areas? 



Please check (/) the appropriate box to the right of each category. 





(1) 
Very 
Little 


(2) 
Some 


(3) 
Quite 
A Bit 


(4) 

Very 

Much 


A. Personal development: under- 
standing one's abilities and 
limitations. Interests, and 
standards of behavior. 










B. Development of friend- 
ships and loyalties of 
lasting value. 










C. Appreciation of Individual- 
ity and Independence of 
thought and action. 










D. Social development: exper- 
ience and skill In relating 
to other people. 










E. Tolerance and understanding 
of other people and their 
views. 










F. Appreciation of religion: 
moral and ethical standards. 
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D. Student Occupational Career Developnient Outcomes 

D-1 Student success in obtaining first job 

D-2 Student success in obtaining preferred first job 

D-3 Occupational career choice 

D-4 Job satisfaction 

D-5 First job earnings 

D-6 Annual total income of former students 

D*-? Employment in major field of study 

D-8 Change and stability of career goals 
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S 

D-1 

MEASURE 
NUMBER 




lEASURE NAME student success in obtaining first job 


lEFINITION 

Number 
withir 


' and percentage of students (graduates and nongraduates ) who are employed 
1 a certain time period after leaving the institution 


)ATA SOURCES 

Exiting Students, Former Students 


PROCEDURES 

Admin 1 


stration of a survey questionnaire 


COMMENTS 



This outcome measure i'fr identified as a potential measure of Vocational 
Preparation (1.4.1.02) in the NCHEMS Inventory of Higher Education Outcome 
Variables and Measures— see Appendix A. 



ERIC 



10 V 

f13 



ACQUISITION PROCEDURES FOR OUTCOME MEASURE 0-1 



The procedure recommended for obtaining data for outcome measure D-1 
requires the use of a survey questionnaire. In addition to the questionnaire 
items, several items have been included to gain the respondents' perceptions 
about (1) how they regwd their first job, (2) how they four»H it, and (3) 
its linkage to their major field of study. 

Procedure for an EXITING-STUDENT Questionnaire 
[SEE NEXT PAGE] 
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1. Do you currently hold or hive you secured a 
full-tlme job (35 hours or more a week) In 
which you plan to work once you complete 
your studies at (Name of Institution)? 

(1) Yes (60 TO QUESTION 2) 

(2) No (SKIP TO QUESTION 9) 



2. For whom do you (or will you) work? (Name 
of employing firm) 



C1^ 



State 



Zip. 



3. What kind of business or Industry Is the 
Job In? (For example* accounting f1rm« 
public schdol. TV manufacturer) 



4. What kind of work does the job Involve? 
(For example, accounting, teaching, 
electrical engineering, welding) 



$• Are you (or will you be): 

( 1) An employee of a private business? 

( 2) Self-employed In your own business? 

( 3) An employee of local, state or 
federal government? 

( 4) A public employee of a non- 
governmental organization? (For 
example, an environmental agency) 



6. Which statement best describes how you regard 
this job at th1s'~{1me? (Please check one) 

( 1 ) Temporary job until a better one can 
be fowid. 

( 2) Temporary job while waiting to report 
to a new job. 

( 3) Temporary job to earn money to do 
something else (travel, school, 
have free time. etc.). 

{4) Job to earn money while I decide what 
kind of work I want. 

( 5) Job with possible career potential. 

( 6) Job with definite career potential 
{7) Other (Please specify) 



7. How did you find your job? (Please check one) 

( 1) Employed at job while completing ii\y 
program 

( 2) School placement officer or Instructor 

( 3) Professional periodicals or organizations 

( 4) Civil Service application 

(S) Public or private employment agency 

( 6) Newspaper advlertisement 

{7) Direct application to employer 

(8) Friends or relatives 

{9) Other (Please specify) 

8. Is your job related to -your major field of 
study (your program)? 

( 1 ) Directly related 

_(2) Somewhat related 

(3) Not related at all 

(NOW GO TO QUESTION ) 

9. Are you currently seeking or planning to seek 
(within 6 months) a full-time job (35 hours or 
more a week)? 

0) Yes (GO TO QUESTION 10) 

W No (SKIP TO QUESTION _J 



10. In what kind of business or industry Is the job 
you are (or will be) seeking? (For example, 
accounting firm, public school. TV manufacturer) 



11. 



What kind of work do you expect to do on the job 
you are (or will be) seeking? (For example, 
accounting, teaching, electrical engineering, 
welding) 
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Procedure tor a FORHER*STUOENT Questionnaire 



1. When you left (Name of Institution) were you 
employed In or had you secured a full-time 
job (3S hours or more a week)? 

{^) Yes (SKIP TO QUESTION 

(2) Nd (GO TO QUESTION 2) 



2. Were you seeking or planning to seek (within 
6 months) a full-time job after leaving 
(Name of Institution)? 

{^) Yes (TO TO QUESTION 10) 

iZ) No (SKIP TO QUESTION _) 



How long did It take you to find your first 
full-time job? 

( 1 ) Less than a month 

iZ) 1 - 2 months 

{3) 3-4 months 

{A) 5-6 months 

(5) more than 6 months 

( 6) I still haven't fbund one 



4* What was (or Is) the name and address of your 
first full»t1me employer? (Name of employing 



City. 



State 



Zip. 



5. What kind of business or Industry was (or Is) 
your first job In? (For example* accounting 
firm* public school, TV manufacturer) 



6. What kind of work did (or does) your first job 
Involve? (For example, accounting, teaching, 
electrical engineering, welding) 



7. 



In your first full-time job after leaving (Name 

(0 



of InstlEinph)* were you (or are you): 

( 1) An employee of a private business? 

( 2) Self-employed In your own business? 

(3) An employee of local, state, or 
federal government? 

( 4) A public en^iloyee of a nongovernmental 
organization? (For example, an environ- 
mental agency • a public school system) 



8* Which statement best describes how ^ou regarded 
(or regard) this first job? (Please check one) 

( 1) Temporary job until a better one could 
be found* 

( 2) Temporary job while waiting to report 
to a new job. 

( 3) Temporary job to earn money to do some- 
thing else (travel, school, have 

free time, etc.). 

( 4) Job to earn money while I decided what 
kind of work I wanted. 

( 5) Job with possible career potential. 

( 6) Job with definite career potential. 
{!) Other (Please specify) 



9. How did you find your first job? (Please check one) 

0) Eimployed at job while completing my 

program 

( 2) School placement officer or Instructor 

{3) Professional periodicals or organizations 

{A) Civil Service application 

{S) Public or private employment agency 

( 6) Newspaper advertisement 

{7) Direct application to employer 

, (8) Friends or relatives 

( 9) Other (Please specify) 

10. Was (or Is) your first full-time job related to 
your major field of study (your program) ? 

i\) Directly related 

( 2) Somewhat related 

(3) Not related at all 
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The open-end questionnaire items in the procedures above have been used by 
the U.S. Bureau of Census to determine the employment sector and the kind 
of work in which a person is involved. They have been suggested here since 
they have the advantage of allowing the respondent to provide his or her 
own answer and obtaining responses that^can be compared to the data the 
Bureau of Census collects in its annual educational attainment survey , which 
is conducted each March. (See U.S. Bureau of Census, Current Population 
Reports; Series P-20 , "Educational Attainment in the United States." 
However, the open-end items have the disadvantage of requiring the data 
processor either to code the responses using the Bureau of Census' cate- 
gories, which are quite detailed, or^to develop his or her own categories 
for coding purposes. 

4^ As ajtpalternative, the following closed-end questionnaire items are suggested 
/ 'gt possible replacements for items 3, 4, and 5 in the EXITING STUDENT Ques- 
tionnaire procedure and items 5, 6, and 7 in the FORMER-STUDENT Questionnaire 
procedure. 
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1. In which of the following employment sectors is your full-ti 
(Please check one) 



Government : 



Education: 

Other Nonprofit 
Organizations: 



Business and Service: 



Other: 



Federal 

State . . . . 

Local i i 

Elementary and Secondary' . i i ] 
Higher Education 

Hospitals, clinics 

Social Welfare 

Church 

Other nonprofit organizations . • 
Self-employed or family business 

Private Company 

Professional partnership . . . . 

Research 

Please specify 



me job? 



(01) 
(02) 
(03) 

m 

(06) 
(07) 
(08) 
(09) 
(10) 

(11) 
(12) 
03) 
(14) 



2. From the list that appears on page , which entry best describes the 

full-time occupation in which you are (or will be) employed? (Please 
write its 3-d1g1t code in the space below.) 



Occupation: 
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D-2 

MEASURE 
NUMBER 



lEASURE NAME 



student success in obtaining preferred first job 



lEFINITION 



Number and percentage of students who received the job of their first 
choice upon leaving the institution 



)ATA SOURCES 



Former Students 



PROCEDURES 



Administration of a survey questionnaire 



COMMENTS 



This outcome measure is identified as a potential measure of Vocational 
Preparation (1.4.1.02) in the NCHEMS Inventory of Higher Education Outcome 
Variables and Measures—see Appendix A. 
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ACQUISITION PROCEDURES FOR OUTCOME MEASURE D-2 

The procedure developed for the acquisition of data for outcome measure D-2 
requires the use of a survey questionnaire. Because of the nature of the 
measure, the procedures are only appropriate for use in a FORMER- STUDENT 
Questionnaire. ' 

Procedure for a FORMER-STUDENT Questionnaire 

It should be noted that questionnaire items 1 and 2 below are suggested 
since they are comparable to those used in the American Council on Edu- 
cation's longitudinal follow-up studies of college students.. As a result, 
the results obtained from the use of these items can be compared to the 
ACE results referenced in Preventing College Dropouts (Astin, 1975) or 
by writing to Dr. Alexander Astin, Graduate School of Education, Univer- 
sity of California at Los Angeles, California. 
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1. In your first full-time job after leaving 
[Name of Institution], which of the following 
MS your first employer? (PLEASE CHECK ONE) First Employer 

^vernment: Federal (01) 

State & Local . _(02) 

Education: Elementary & Secondary ^(03) 

Higher Education (W) 

Other Nonprofit 

Organizations: Hospitals* clinics (OS) 

Social welfare _(06) 

Church l07) 

Other non-profit organizations. . . iGB) 

Business & Service: Self-employed or family business. . ^(09) 

Private company ho) 

Professional partnership 

Research. _(12) 

Other: (Please specify) 

(13) 



How much of the work in this first full-time 
job was devoted to the following activities? 
(CHECK ONE FOR EACH ACTIVITY) 





(1) 
A Major 
Amount 


(2) 
A Minor 
Amount 


(3) 
None 


A. Teaching 

■ k 








B* Research and Development 








C. Administration or Management 








0. Service to patients or clients 








E. Other (Specify) 









Was your first full-time job after leaving [Name of 
Institution] the job you most preferred at the time? 



Jl) Yes 
J2) No 



4. Which statement best describes how you 
regarded your fi rst job? 
(PLEASE CHECK 0^ 

(}) Temporary job until a better 

one could be found. 

( 2) Temporary job while waiting to 
report to a new job, 

(3) Temporary job to earn money to 

do something else (travel, 
school* have free time, etc.). 

W Job to earn money while I 

decide what kind of work I wanted. 

(5) Job with possible career 

potential . 

(S) Job with definUe career 

potential . 

(7) Other (Please specify) 



5. How did you find your first job after 
leaving [Name of W^stitution]? 
(PLEASE CHECK ONE) 

(1) Employed at job while completing 
rny program. 

[2) School placement officer or 

instructor. 

(3) Professional periodicals or 

organizations. 

( 4) Civil Service application 

' t 

(S) Public or private employment 

agency. 

(S) Newspaper advertisement. 

^ i7) Direct application to employer. 

(8) Friends or relatives. 
(9) Other (Please specify) 



Was your first job related to your major 
field of study (your program)? 

(1) Directly related 

(2) Somewhat related 

(2) Not related at all 
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As an alternative to questionnaire items 1 and 2 above, one may wish to consider 
the following three questions which have been used by the U.S. Bureau of Census 

to determine the employment sector and kind of work a person is doing or has 

t J 

done. Responses to these questions and those pertaining to questions 4, 5, and 
6 above can be compared to data the Bureau of Census collects in its annual edu- 
cational attainment survey which is conducted each March. (See U.S. Bureau of 
Census Current Population Reports: Series P-20. "Educational Attainment in 
the United States.") 



1. In what kind of business or industry was (or is) your first full-time 

f'^'"'^ °f Institution]? Vor exaSpleTWount ng 
firm, public school, TV manufacturer) ""Muing 



M I i 



2. What kind of work did (or does) your first full-time job involve? (For 
example, accounting, teaching chemistry, electrical engineering) 

I I I I 

,k , 

3. In y6ur~first job were you (or are you): 

(1) An employee of a private business? 

(2) Self-employed in your own business? 

(3) An employee in local, state, or federal government? 

(4) A public employee in a nongovernment organization? (For example, 

an environmental agency, a public school system, a public hospital) 
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Another alternative for questionnaire Items 1 and 2 above Is the 
following: 



1. From the 11st that appears on page • which entry best describes 

your first full-time occupation after leaving [Name of Institution]? 
(Please write its 3-digit code in the space below.) 

Occupation: r I 1 I , ^ 
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MEASURE 
NUMBER 



lEASURE NAME 



Occupational Career Choice 



lEFINITION 



Number and percentage of students choosing a particular occupational 
career (that is, their employment goals) 



)ATA SOURCES 



Current Students, Exiting Students, Former Students 



PROCEDURES 



Administration of a survey questionnaire 



COMMENTS 



This outcome measure Is Identified as a potential measure of Vocational 
Aspirations (1.4.2.04) In the NCHEMS Inventory of Higher Education Outcome 
Variables and Measures—see Appendix A. 
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ACQUISITION PROCEDURES FOR OUTCOME MEASURE D-3 

The procedures developed for obtaining data for outcome measure D-3 ca11 for 
the use of a survey questionnaire. Two alternative sets of questionnaire Items 
have been develpped for use In a survey of current students, exiting students, 
or former students (graduates and nongraduates). 

Procedures for a CURRENT-, EXITING-, or FORMER-STUDENT Questionnaire 

Two alternative sets of questionnaire Items are presented for Indl.uslon In 
•a CURRENT-, EXITING-, or FORMER-STUDENT Questionnaire. Alternaclve #1 can 
be used If one Is Interested In knowing about the respondent's long-run 
career employer and the specific job position the respondent hopes to enter 
In his or her long-run occupational career . Alternative #2 can be useful If 
one Is Interested In knowing the respondent's Intentions regarding his or her 
long-run career employer and the job activities the respondent Intends to 
engage In during his or her long-run career. An advantage of the second 
alternative set of Items Is that they are compatible with those used In the 
American Council on Education's longitudinal follow-up studies on college 
students. As a result, the results obtained from the use of these Items can 
be compared to the ACE results referenced In Preventing College Dropouts 
(Astin, 1975) or by writing to Dr. Alexander Astin, Graduate School of 
Education, University of California at Los Angeles, California. 
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Alternative #1 



1. We would like to find out about your long-run occupational career goals. 



/ 



a. Over the long-run . In which employment sector are you primarily 
Interested ^n working? (PLEASE CHECK ONE) 



Government: 



Education: 

Other Nonprofit 
Organizations: 



Business and Service: 



Other: 



Federal ......... 

State .... 

Local 

Elementary and Secondary 
Higher Education . . . . 



Hospitals, clinics 

Social Welfare 

Church 

Other nonprofit organizations . ■ 
Self-employed or family business 

Private Company 

Professional partnership • • • ■ 

Research 

Please specify 



Long-run 

Career 

Employer 

_ (01) 
_ (02) 
(03) 

-m 



(06) 

(07 

(08) 

(09) 

(10 

(11 

(12 

(13) 

(14) 



From the list that appears on page , which entry best 

describes your expected long-run career work? (Please write 
its 3-d1g1t code In the space below.) 

Long-run Occupational Career: I i I I 



c. How sure are you of your choice in "b"? 

(1) Quite sure 

(2) Somewhat sure 

(3). Not sure 
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Alternative #2 



m 



1. We would like to find out about your long-run occupational career goals 
and activities: 

a. In the long-run, whom do you expect will be your career employer? 
(PLEASE CHECK ONE) 



Government: 

Education: 

Other Nonprofit 
Organizations: 

Business and Service: 
Other: 



Federal . . . 

State 

Local . . . 

Elementary and Secondary . . . , 
Higher Education 

Hospitals, clinics 

Social Welfare 

Church • • • 

Other nonprofit organizations.. • 
Self-employed or family business 

Private Company ... 

Professional partnership . . . . 

Research 

Please specify 



Long-run 

Career 

Employer 

_ (01) 
_ (02) 
_ (03) 

z m 

(06) 

- (07) 
~" (08) 
~ (09) 

- (10 
^ (11) 
~ (12) 

- (13) 
Z(14) 



How much of your long-run career work do you expect wi11 be devoted 
to each of the following job activities? (Please check one for each 
activity.) 
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Job Activities 


Lonq-run Career Work 


(1) 
A Major 
Amount 


(2) • 
A Minor 
Amount 


(3) 
None 


A. Teaching 








B. Research and Development 








C. Administration or Management 








D. Service to customers, 
patients, or clients 








E. Other (Specify) 

_- : ^, • 
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MEASURE 
NUMBER 



EASURE NAME 



Job Satisfaction 



EFINITION 



The general satisfaction of former students with their job experiences 



)ATA SOURCES 



Former Students 



PROCEDURES 



Administration of a survey questionnaire 



COMMENTS 



This outcome measure Is Identified as a potential measure of Vor^atlonal 
Preparation (1.4.1.02) In the NCHEMS Inventory of Higher Education Outcome 
Variables and Measures— see Appendix A. 
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ACQUISITION PROCEDURES FOR OUTCOME MEASURE D-4 



The procedure presented for determining job satisfaction Involves the use 
of a survey questionnaire. Interest In job satisfaction as an outcome 
measure could relate to a former student's satisfaction with his or her 
first job or with his or her current job. As a result, questionnaire Items 
have been developed to serve both purposes. Whether both Items would be 
used In the same questionnaire would depend on the purpose of the data 
collection effort. 

Procedures for a FORMER-STUDENT Questionnaire 



[SEE FOLLOWING PAGE] 
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Alternative #1 : Satisfaction with first job. 



1. In general, how well did you (or do you) like your first job after 
leaving [Name of Institution]? 

(1) I didn't (don't) like it. 

(2) I was (am) more or less neutral about it. 

(3) I liked (like) it. 

(4) I was (am) enthusiastic about it. 

2. Which statement best describes how you regarded (or regard) this 
first job? (PLESsTCHECK ONE) 

(1) Temporary job until a better one could be found. 

(2) Temporary job while waiting to report to a new job. 

(3) "temporary job to earn money to do something else 

(travel, school, have free time, etc.). 

(4) Job to earn money while I decided what kind of work I wanted. 

(5) Job with possible career potential. 

(6) Job with definite career potential. 

(7) Other (Please specify) 

3. Was (or is) your first full-time job related to your major field of 
study (your program)? 

^^(1) Directly related 

(2) Somewhat related 

(3) Not related at all 
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Alternative #2: Satisfaction with current job. 



1. 


In general, how well do you like your current job? 




(1) 


I don't like it. 




(2) 


I am more or less neutral about it. 




(3) 


I like it. 




(4) 


I am enthusiastic about it. 


2. 


Which statement best describes how you regard this job at this time? 
(PLEASE CHECK ONfT" 




(1) 


Temporary job until a better one can be found. 




(2) 


Temporary job while waiting to report to a new job. 




(3) 


Temporary job to earn money to do something else 
(travel, school, have free time, etc.). 




(4) 


Job to earn money while I decide what kind of work I want. 




(5) 


Job with possible career potential. 




(6) 


Job with definite career potential. 




(7) 


Other (Please specify) 


3. 


Is your job related to your major field of study (your program)? 




(1) 


Directly related 




(2) 


Somewhat related 




(3) 


Not related at all 
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D-5 



MEASURE 
NUMBER 



EASURE NAME 



First job earnings 



EFINITION 



Level of earnings of exiting and fonner students on their first full-time 
job (35 hours or more a week) after leaving school 



)ATA SOURCES 



Exiting Students, Former Students 



PROCEDURES 



Administration of a survey questionnaire 



:OMMENTS 



This outcome measure is identified as a potential measure of Vocational 
Preparation (1.4.1.02) In the NCHEMS Inventory of Higher Educational Outcome 
Variables and Measures— see Appendix A. 
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ACQUISITION PROCEDURES FOR OUTCOME MEASURE D-5 

Two alternative procedures are suggested for identifying the level of 
earnings of exiting or former students on their first job after leaving 
the institution. Both require the use of a survey questionnaire. 

The first alternative uses an open-end question to obtain the data needed 
to derive this measure. Its advantages include (1) a precise identification 
of the respondent's actual earnings on his or her first job, and (2) data 
that are very conducive to statistical analysis since they can easily be 
computed into a mean or median amount of earnings. 

The second alternative incorporates a closed-end approach. The major advan- 
tage of this alternative is that categories are already available for quick 
and easy analysis. 

Procedures for an EXITING-STUDENT or FORMER-STUDENT Questionnaire 
[SEE FOLLOWING PAGE] 
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Alternative #1 : 



1. In your first full-time job (35 hours or more a week)) after 
leaving [Name of Institution], what is (or was) your gross salary 
or wage? (PLEASE FILL IN ONE) 



$ (1) per year 

$ (2) per week 

J (3) per hour 

(4) Don't know 

(check) 



Alternative #2: 



1. In your first full-time job (35 hours or more a week) after leaving 
[Name of Institution}, approximately what is (or was) the gross annual 
or weekly earnings associated with the job? (PLEASE CHECK ONE) 



m 


Less than $3,000 per year (less than $58 ,jr week) 


__(02) 


$3,000 • 


- $5,999 per year ($58 - $114 per week) 


_(03) 


$6,000 ■ 


- $8,999 per year ($115 - $172 per week) 


_(04) 


$9,000 ■ 


- $11,999 per year ($173 - $230 per week) 


(05) 


$12,000 


- $14,999 per year ($231 - $287 per week) 


(06) 


$15,000 


- $17,999 per year ($288 - $345 per week) 


_(07) 


$18,000 


- $20,999 per year ($346 - $403 per week) 


_(08) 


$21 ,000 


- $23,999 per year ($404 - $461 per week) 


_(09.) 


$24,000 


- $26,999 per year ($462 - $518 per week) 


_(io) 


$27,000 


- $29,999 per year ($519 - $576 per week) 




$30,000 


and over per year ($577 or more per week) 
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0-6 



MEASURE 
NUMBER 



1EASURE NAME 



. Annual total Income of former students 



)EFINITION 



Number and percentage of former students who are at a particular annual income 
level within a certain time period after leaving the institution 



)ATA SOURCES 



Former Students 



PROCEDURES 



Administration of a survey questionnaire 



COMMENTS 



This outcome measure is identified as a potential measure of Vocational 
gr'eparation (1.4.1.02) in the NCHEMS Inventory of Higher Education Outcome 
Variables and Measures—see Appendix A. 



ACQUISITION PROCEDURES FOR OUTCOME MEASURE D-6 



The procedure developed for obtaining data for outcome measure D-6, Annual 
Total Income of Former Students, calls for the use of a survey questionnaire. 
The three questionnaire Items recommended for use In this procedure are 
designed to determine not only the respondent's annual salary, but also the 
total amount of dollars he or she has at his or her disposal at this time. 

Procedure for a FORMER-STUDENT Questionnaire 

[SEE FOLLOWING PAGE] 
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1. Approximately what is the annual salary or weekly wage you earn 
in your current job? (PLEASE CHECK ONE) 



—.(01) 


Less than $3,000 per year (less than $58 per week) 


m 


$3,000 • 


• $5,999 per year ($58 - $114 per week) 


__(03) 


$6,000 • 


• $8,999 per year ($115 - 


$172 per week) 


.(0*) 


$9,000 • 


• $11,999 per year ($173 ■ 


- $230 per week) 


(05) 


$12,000 


- $14,999 per year (Jt231 


- $287 per week) 


(06) 


$15,000 


- $17,999 per year ($288 


- $345 per week) 


(07) 


$18,000 


- $20,999 per year ($346 


• $403 per week) 


_(08) 


$21 .000 


- $23,999 per year ($404 


* $461 per week) 


(09) 


$24,000 


- $26,999 per year ($462 


- $518 per week) 


(^0) 


$27,000 


- $29,999 per year ($519 


* $576 per week) 


__(n) 


$30,000 


and over per year ($577 or more per week) 



2. If you are married and your spouse is employed, what is the approximate 
annual salary or weekly wage your spouse earns in his or her current 
job? (PLEASE CHECK ONE) * 

(01) Less than $3,000 per year (less than $58 per week) 

(02) $3,000 - $5,999 per year ($58 - $114 per week) 

(03) $6,000 - $8,999 per year ($115 - $172 per week) 

. (Oi) $9,000 - $11,999 per year ($173 - $230 per week) 

(05) $12,000 - $14,999 per year ($231 - $287 per week) 

(06) $15,000 - $17,999 per year ($288 - $345 per week) 

(07) $18,000 - $20,999 per year ($346 - $403 per week) 

(08) $21,000 - $23,999 per year ($404 - $461 per week) 

(09) $24,000 - $26,999 per year ($462 - $518 per week) 

_^(10) $27,000 - $29,999 per year ($519 - $576 per week) 
^(11) $30,000 and over per year ($57Z or more per week) 

3. What is your current estimated annual income from other sources as 
interest earned from savings accounts, profits from rental properties? 
(Please write in your estimate in the space below.) 

Income from other sources = $ _/year 
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D-7 

MEASURE 
NUMBER 



EASURE NAME 



Employment in major field of study 



EFINITION 



Number and percentage of exiting or former students who are employed in a 
job related to their program of study 



ATA SOURCES 

Exiting Students, Former Students 



ROCEDIJRES 



Administration of a survey questionnaire 



:OMMENTS 



This outcome measure is identified as a potential measure of Vocational 
Preparation (1.4.1.02) in the NCHEMS Inventory of Higher Education Outcome 
Variables and Measures— see Appendix A. 
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ACQUISITION PROCEDURES FOR OUTCOME MEASURE D-7 



The procedures for obtaining data for outcome measure D-7 require the use 
of a survey questionnaire. The questionnaire items used to obtain the 
necessary data should be included in the section of an EXITING-STUDENT 
or FORMER-STUDENT Questionnaire that relates to occupational career 
information. 

Procedure for an EXITING-STUDENT or FORMER-STUDENT Questionnaire 

The following set of items assumes that a respondent has indicated he or she 
has a job. 
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1. Is your job related to your major field of study (your major program)? 
(1) Directly related 

(2) Somewhat related * 

(3) Not related at all 

2. How well do you feel your studies at [Name of Institution] prepared 
you for this job? 

(1) Excellent preparation 

{2) Good preparation 

(3) Fair preparation 

(4) Poor preparation 

3. If you are employed outside your major field of study at [Name of 
Institution], why? (CHECK ALL THAT APPLY) 

0) Never really planned to work in iny major field 

1(2) Tried but could not find a job in my major field 

(3) Did not feel I learned enough in iny major field 

(4) Decided I did not like the work in my major field 

_(5) Too little opportunity for advancement in my major field 

(6) Developed new career interest 

(7) Better job opportunity came along ' — 

(8) Other (Please specify) 
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D-8 



MEASURE 
NUMBER ' 



EASURE NAME 



EFINITION 



Change and Stability of Career Goals 



The number and percentage of former students who have maintained or changed thetr 
career goals between the time they left the institution and the present time 



lATA SOURCES 



Former Students 



PROCEDURES 



Administration of a survey questionnaire 



:OMMENTS 



This outcome measure is identified as a potential measure of Vocational 
Aspirations (1.4.2.04) in NCHEMS Inventory of Higher Education Outcome 
Variables and Measures— see Appendix A. 
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ACQUISITION PROCEDURES FOR OUTCOME MEASURE D-8 

The procedures developed for obtaining outcome measure D-8 require the 
use of a survey questionnaire. The questionnaire items presented below 
are intended to cope with the situation in which a user has no prior infor- 
mation about the respondent's occupational career choice at the time the 
respondent left the institution. 

Procedures for a FORMER- STUDENT Qustionnaire 

[SEE FOLLOWING PAGE] . 
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1. The following items are intended to help us learn whether you have 
changed your "desired" long-run career employer and long-run career 
occupation since you left [Name of Institution]. 



a. PLEASE CHECK ONE IN EACH COLUMN; 



o 



Government: 
Education: 



Other Nonprofit 
Organizations: 



Desired 
EMPLOYER 
When You Left 
[Name of Institution] 



Federal 

State 

Local ... 

Elementary and 

Secondary 

Postsecondary 

Education 

Hospitals, clinics. . . . 

Social Welfare 

Church 

Other nonprofit 

organizations 

Self-employed or Family 

Business . 

Private Company 

Professional Partnership, 

Research . . . 

(Please specify) 



Desired 

EMPLOYER 
At This 
Time 



(01) 


(01) 


(02) . . 


(02) 


(03) 


(03) 


(04) . . 


(04) 


(05) . . 


m 


(06) . . 


(06) 


(07) . . 


(07) 


(08) . . 


(08) 


(09) . . 


(09) 


(10) . . 


(10) 


(11) 


(11) 


.(12) . . 


(12) 


.(13) . . 


(13) 


.(14) . . 


(14 



b. From the list that appears on page , please write in the 3-digit 

code of the entry that applies to each of the following two questions: 

(1 ) What was your desired long-run career 

occupation when you left [Name of Institution]? | i i i 

(2) What is your desired long-run career 

occupation at this time? | | | | 
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student Personal Development 

(No outcome measures. and data acquisition procedures are 
presented In this category in this version of the Manual . ) 
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F. Student Socia1/Cu1tura1 Development 

" k- . ■ . : 

(Mo outcome measures and data acquisition procedures are 
presented ir) this category in this version of the Manual . ) 
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SECTION III 



NEW KNOWLEDGE AND ART FORMS 
MEASURES AND PROCEDURES 

The outcome data acquisition procedures presented In this section are Intended 
to obtain selected outcome measures that potentially reflect the results and 
Impacts of postsecondary Institutions and their programs In two broad areas: 
the development of new knowledge and the development of new art forms. 

G. Development of New Knowledge 

^ G-1 Research proposals funded 
G-2 Research restricted revenues 

H. Development of New Art Forms 

(No measures and procedures are presented In this category 
In this version of the Manual . ) 

The extremely limited size of this set of outcome measures reflects the fact 
that our understanding of the nature and attributes of outcomes In this area 
Is less thoroughly developed than for any other categories of outcomes. The 
long-term nature of many new knowledge and art forms outcomes combines with the 
diversity of the recipients to which they accrue to make the question of 
measurement more complex than for any other type of outcomes. It Is hoped 
tha developmental work currently underway at NCHEMS and elsewhere will con- 
tribute to understanding In this area. 

In keeping with the emphasis on operational feasibility that pervades this 
edition of the manual, only a few measures were selected for Inclusion at 

110 
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this time. These measures clearly are not meant to reflect the full range 
of new knowledge and art forms measures. They are, however, considered to be 
useful proxies and were endorsed by the respondents to the NCHEMS Higher 
Education Outcome Measures Identification Study. Later editions of the manual 
will include a significantly expanded set of new knowledge and art forms 
measures and procedures. In fact, the present measures serve as "pointers" 
toward this further development in addition to representing useful information 
items in their own right. 
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Development of New Knowledge 

G-1 Research proposals funded 
G-2 Research restricted revenues 
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G-1 



MEASURE 
NUMBER 



lEASURE NAME 



Research proposals funded 



)EFINITION 



Number and percentage of research proposals that were funded within a 
certain time period, by PCS subprogram, annual level of funding and 
duration of funding 



)ATA SOURCES 



Institutional Research Contracts Officer or Faculty/Staff 



PROCEDURES 



Search of institutional records 



COMMENTS 



This outcome measure Is Identified as a potential proxy measure of Discovery 
of New Knowledge (2.0.0.01) and Interpretatloifi and Application of New Knowledge 
(Z.OiO.OZ) in the NGHEMS Inventory of Higher Education Outcome Variables and 
Measures—see Appendix A. 
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ACQUISITION PROCEDURES FOR OUTCOME MEASURE G-1 



The procedural steps recommended for obtaining data for outcome measure 
G-1 require the use of Institutional records that contain Information about 
research proposals that have been acted upon and funded by various funding 
sources. A proposal Is defined as acted upon once It has been submitted 
to a funding organization and the funder has made a decision to fund or 
not fund the proposal. Normally, this Information can be collected from 
an Institution's office for grants and contracts. If such an office doesn't 
exist, a survey of the heads of academic departments and research centers 
In the Institution will need to be conducted to obtain the data necessary 
for deriving this measure. Once the appropriate data source Is determined, 
the following steps can be Implemented: 

1. Specify the time period for which the measure will be 
derived (for example, fiscal year). 

2. For each organizational unit within subprograms 2.1""Inst1tutes 
and Research Centers and 2.2--Ind1v1dual or Project Research of 
the NCHEMS revised Program Classification Structure (PCS), 
Identify the number of research proposals that have been 
acted upon by funders In the specified time period. 

3. For each proposal that was acted upon Identify: 

a. The requested level of total funding. 

b. The requested duration of funding using the following 
categories: 
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(1) less than 1 year 

(2) 1-3 years 

(3) More than 3 years 

c. Whether or not the proposal was funded. 

For each acted upon proposal that was funded identify: 

a. ; The actual level of funding; 

b. The actual duration of funding. 

Data should now be available for determining the number of 
proposals funded as a percentage of proposals acted upon, by 
PCS 2.0 sub-program ca^gories, level of funding, and duration 
of funding. 
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G-2 



MEASURE 

NUMBEH 



EASURE NAME 



Research restricted revenues 



EFINITION 



Total research restricted revenues as a percentage of the total budget, 
by PCS program activity center and by source of revenues 



)ATA SOURCES 



Institutional Budget Officer 



mEDIJRES 



Search of Institutional records 



:OMMENTS 



This outcome measure Is Identified as a potential proxy measure of Discovery 
of New Know! edge (2.0.0.01) and Interpretation and Application Of New 
Knowledge (2.0.0.02) In the NCHEMS Inventory of Higher Education Outcome 
Variables and Measures—see Appendix A. 
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ACQUISITION PROCEDURES FOR OUTCOME MEASURE G-2 



The procedural steps reconmended for obtaining data for outcome measure G-2 
ca11 for the use of Institutional records concerning revenues received by 
the research program activity centers In the Institution. The data neces- 
sary for deriving this measure should be avallrhle In the Institution's 
business office or In the office for grants and contracts. 

The following steps are used for deriving data for measure G-2: 

1. Specify the time period for which the measure w111 be 
derived (for example , the academic year). 

2. For each organizational unit within subprograms 2.1— Institutes 
and Research Centers and 2.2— Individual or Project Research of 
the NCHEMS revised Program Classification Structure ^ Identify the 
total restricted current fund revenues expended from the following 
source categories: 

a. Governmental Grants and Contracts: 

(1) Federal 

(2) State 

(3) Local 

b. Private Gifts, Grants, and Contracts. 

The following data display format can be used for organizing the revenue 
data: 
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: ■ 

SOURCE OF REVENUES (Restricted) 




2.0 RESEARCH 


Government Grants & Contracts 


Private 


Total 


PROGRAM CATEGORIES 


Federal 


State 


Local 


Gifts, 
Contracts 




2.1 Institutes & Research Centers 












2.1.0100 

2.1.0200 NOTE: Refer to 

Appendix E for a com- 
|b1ete listing of the 
HEGIS disciplines. 












2.1.5500 
2.1.9200 












2.2 Individual or Project Research 












2.2.0100 

2.2.0200 NOTE: Refer to 

Appendix E for a com- 
plete listing of the 
HEGIS disciplines. 












2.2.5500 
2.2.9200 













3. Identify total budget for each organizational unit in sub- 
programs 2.1 and 2.2 of the PCS. < 

4. Once step 3 is completed, the total restricted revenues expended 
as a percentage of the total budget for the designated time 
period can be calculated for each organizational unit associated 
with 2.1 and 2.2 of the PCS. 
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Development of New Art Forms 

(No outcome measures and data acquisition procedures are 
presented In this category In this version of the Manual > ) 
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SECTION rv 

COMMUNITY IMPACT 
MEASURES AND PROCEDURES 

The outcome data acquisition procedures presented In this section are Intended 
to obtain data for selected outcome measures that potentially reflect the Impacts 
of a postsecondary Institution and Its program on the local community. The 
data acquisition procedures tnduded In this section are presented for the 
following outcome measures, which have been grouped Into three subcategories: 

I. Community Impact: Education 

1-1 Enrollment of non-degree/d1p1oma/cert1f1cate students 

1-2 Community participation In community education programs 

1-3 Community participation In extension services 

^ 1-4 Educational goals achieved by community participants 

J. Community Impact: Service 

J-1 Institution's participation In community affairs 
J-2 Community participation In an Institution's social, 

cultural, and recreational programs 
J-3 Community use of Institutional facilities 

K. Communi ty Impact: Economic 

K-1 Institution's payment of local taxes and state taxes 

and tax compensation 
K-2 Institution's purchase of locally provided utilities 
K-3 Institution's purchase of locally delivered goods 

and services 

K-4 Institution's capital equipment expenditure relevant 

to the local community 
K-5 Institution's capital construction expenditure 

relevant to the local community 
K-6 Local expenditures by faculty and staff 
K-7 Local expenditures by students 
K-8 Local expenditures by visitors 
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The information generated from the outcome data acquisition procedures 
presented in this section should be helpful in identifying what impact or 
consequences an institution has had on a community in terms of community 
education, social and cultural services, and economic activities. They 
also should help institutions assess how meaningful and effective their 
programs are so that institutions can better fulfill their mission regarding 
the development of and service to the community. 

The community impact measures in the manual focus on the local community. It 
is important to note, however, that the local community should not necessarily 
be restricted to the legal or jurisdictional boundary, but rather should be 
defined as the functional local community in which the impact of an institution 
is directly and physically felt. Possible criteria for defining the functional 
local community would include: 

1. The geographical area in which the majority of an institution's 
students, faculty, and staff reside; 

2. The community in which an institution's major business trans- 
actions (purchase of goods and services) take place; and 

3. The community in which an institution's direct public service 
activities (for example, agricultural extension service) are 
arranged to meet the needs of particular groups. 

Since institutions vary widely from one another with respect to what precisely 
constitutes their functional or operational local community, it seems best to 
leave the task of defining the functional local community to each user. The 
user may wish to explore impacts using more than one of these definitions. 
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Community Impact: Education 

1-1 Enrollment of non-degree/dlploma/certlflcate students 
1-2 Community participation In community education programs 
1-3 Community participation In extension services 
1-4 Educational goals achieved by community participants 
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I-l 



MEASURE 

NUMBER 



1EASURE NAME 



Enrollment of non-degree and non-certificate seeking students 



)EFINITION 



The number of persons, who are not seeking a degree or certificate (nonmatriculating 
students), enrolled in regular credit-producing instructional programs or courses, 
as defined by subprograms 1.1 and 1.2 in the NCHEMS Program Classification 
Structure (PCS) 



)ATA SOURCES 



Institutional Student Records 



PROCEDURES 



Search of Institutional Records 



:OMMENTS 



This outcome measure is identified as a proxy measure of an institution's 
contribution to Community Educational Development (3.1.0.01) in the NCHEMS 
Inventory of Higher Education Outcome Variables and Measures-see Appendix A. 
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ACQUISITION PROCEDURES FOR OUTCOME MEASURE 1-1 

The data acquisition procedures developed for outcome measure 1-1 are re1a- 
tively straightforward ipy^he sense that they require a single headcount of 
"nonmatriculating" st^^r?ts, that is, of those students who are not working 
toward a degree or a certificate, who are enrolled in credit-producng pro- 
grams or courses. The procedures suggest that the NCHEMS Program Classification 
Structure (Gulko, 1972 and Collier, 1975) be used to organize the different 
credit-producing programs in which the "nonmatriculating students" are enrolled. 

Procedures for Use of Institutional Records 

1. Determine the time period during which the number of 
non-degree and non-certificate seeking students enrolled 

in credit- producing instructional programs will be ascertained. 

2. Examine the individual student files and identify all 
"nonmatriculating students." 

3. For the students identified in 2 above, identify those 
who are enrolled in the PCS Instructional Subprograms: 
1.1— General Academic Instruction, and 

1 .2*-0ccupational and Vocational Instruction. 

4. Next identify the PCS Subprogram Categories in which 
they are enrolled, such as 1.1.0201— Environmental 
Design or 1.2.5007— Photography Technologies. 

5. For a descriptive summary of the data, total the 
number of "nonmatriculating students" enrolled in 
each Subprogram Category of the PCS. 
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1-2 

MEASURE 
NUMBER 



EASURE NAME 



Community participation in community education programs 



EFINITION 



The number of persons, who are not seeking a degree or certificate (non- 
matriculating students), enrolled in non-credit-producing instructional 
activities that are offered on or off campus 



ATA SOURCES 



Institutional Student Records 



PROCEDURES 



Search of Institutional Records 



:OMMENTS 



This outcome measure is identified as a proxy measure of an institution's 
contribution to Community Educational Development (3.1.0.01) in the NCHEMS 
Inventory of Higher Education Outcome Variables and Measures—see Appendix A 
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ACQUISITION PROCEDURES FOR OUTCOME MEASURE 1-2 



The procedures for obtaining data for outcome measure 1-2 require a simple 
headcount of those persons enrolled in those non-credit-producing instruc- 
tional activities as defined by Subprogram 1 .3— Community Education in the 
revised Program Classification Structure (Collier, 1975). In the revised 
PCS, the definition of Subprogram 1 .3~Community Education is defined as 
follows: 

Community Education-*-l .3 includes those instructional activities 
that are noncredit and are therefore not applicable towards a post- 
secondary degree or certificate. These instructional activities 
may be offered both on or off campus and may be taken by either 
matriculated students or members of the general community. Any 
work that produces credit toward the high school diploma should 
be included in 1 .4— Preparatory and Adult Basic Education. 

Examples of Community Education Include: 

- Avocational Education (wine testing, weaving, guitar, and so forth) 

- Adult Education 

- Professional Review Courses 

- Refresher Courses 

In the procedural steps that follow, a distinction is made between matricu- 
lating students who are enrolled in such activities and nonmatriculating 
students who are enrolled. 

Procedures for Use of Institutional Records 

1. Determine the time period during which the number of persons 
participating in non-credit-producing Community Education 

ir>a'. 
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instructional activities (as defined by Subprogram 1.3 in 
the NCHEMS revised Program Classification Structure) will 
be ascertained. 

2. List all instructional activities that would be classified 
in the PCS Subprogram 1.3~Community Education during the 
time period in focus. 

3. Examine the individual student files and identify the 
matriculating students who have enrolled in each Community 
Education activity identified in 2 above, and then the 
nonmatriculating students who have enrolled in each of 
those activities. 

4. The data should now be organized for outcome measure 1-2. 



15' 

ERIC 175 



hriimiimrn-'iaaaa 



NATIONAL CENTER FOR HIGHER EDUCATION MANAGEMENT SYSTEMS 
Outcome Measures and Procedures Manual ^ 



1-3 

MEASURE 
NUMBER 



lEASURE NAME 



Community participation in extension services 



lEFINITION 



The number of persons from the community who have participated in cooperative extension 
service activities as defined by Subprogram 3.3 in the NCHEMS Program Classification 
Structure (PCS) 



)ATA SOURCES 



Institutional records maintained in the office responsible for cooperative 
extension service activities 



PROCEDURES 



Search of institutional records 



:OMMENTS 



This outcome measure is identified as a proxy measure of the extent to which 
the community receives direct assistance and services of various types from 
the primary programs of the institution. See Extension Services (3.2.0.01) in 
the NCHEMS Inventory of Higher Education Outcome Variables and Measures, 
presented in Appendix A. 
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ACQUISITION PROCEDURES FOR OUTCOME MEASURE 1-3 



This outcome measure represents one indicator of the impact the institution 
and its programs have on the community. In developing the procedures for 
obtaining this measure, the following definition of Cooperative ExtensiorT 
Service, as defined by the NCHEMS Program Classification Structure (Gulko, 
1972), was used: 

Cooperative Extension Service (subprogram 3.3) is established as a 
separate subprogram to accommodate the program elements /that are. 
established as the result of cooperative extension efforts between 
the institution and outside agencies, e.g., agriculture extension, 
urban extension. This subprogram is intended primarily for land- 
grant colleges and universities. The distinguishing feature of 
program elements in subprogram 3.3 is that the programmatic and 
fiscal control is shared by the institution with one or more govern- 
mental units. Historically, agriculture extension and increasingly 
certain urban extension programs represent a significant commitment 
of resources that are not necessarily under the control of the insti- 
tution in terms of the programmatic direction of the activities. 
These cooperative extension programs are often a cross between 
independent operations and public service in that they represent a 
mix of resources belonging to the institution and resources under 
the control of an agency external to the institution. 



Procedures for Use of Institutional Records 



1. Identify the time period during which the number of community 
members participating in Cooperative Extension Service activities 
(PCS Subprogram 3.3) will be determined. 

2. List all the Cooperative Extension Service programs that have 
been available to members of the general community during the 
period of time in focus. 
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Identify the number of participants in each program, (bo ndf 
include persons who participate In these programs for purposes 
of seeking credit toward a degree or certificate.) 
For a descriptive summary of the data, list the total number of 
community participants for each cooperative extension service 
program offered during the period of time In focus. 
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1-4 



MEASURE 
NUMSER 



EASURE NAME 



Educational goals achieved by community participants 



EFINITION 



The degree of perceived personal Improvement and satisfaction with respect to 
job promotion and salary Increase, development of technical skills, leadership 
and human relations, and other personal attributes among community participants 
In Institutional programs 



)ATA SOURCES 



Persons In the community who have participated In specific educational programs 
on and/or off campus 



PROCEDURES 



Administration of a Survey Questionnaire 



This general outcome measure represents a counterpart to many of the Student 
Growth and Development Measures In Section II of this Manual. Instead of 
measuring the dimensions of student growth and development, however, the 
above outcome measure Is aimed at measuring the growth and development of 
those persons who come Into contact with the Institution and Its programs 
but are not seeking a degree or certificate* 
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ACQUISITION PROCEDURES FOR OUTCOME MEASURE 1-4 

The procedure recommended for obtaining data for outcome measure 1-4 
requires the development and use of a survey questionnaire. 

Procedures for a Questionnaire of Community Members Taking Courses 



Tht following questionnaire Items art Intended to learn If the edu- 
catlonal activities In which you Participated at [Name of Institution] 
helped you achieve your educational goals. 

!• Hease Identify the name of the educational program (or courses) 
In which you participated during (Period of tine). 



2. Uhlch of the following statements best describe your reasons for 
participating In the above proqrain(s)? Please check all that 
apply. Also, Indicate to the right of those statetnents you have 
checked the extent to which your expectations were realized as a 
result of your Involvement. 





(1) 
Very 

Much 


(2) 
QuUe 
A Bit 


(3) 
Some- 
what 


(4) 

Not 
At All 




To Increase nv chances to 
qualify for a new job or 
occupation. 












To enhance chances foi* 
a possible Increase In 
salary and/or possible 
Job promt Ion. 












To Improve my human rela- 
tions skills and/or leader- 
ship skills. 












To Improve my knowledge an<j 
technical skills required 
In flv work. 










_:(5) 


To Improve my general know* 
ledge and skills for 
personal satisfaction. 












To have a personal ex- 
perience with the 
academic world. 












Other (Mease specify) 























3. In reflecting upon your experiences In these programs, would y( 
reconnend them to a friend or a relative who Is In a situation 
similar to yours? 

0) Definitely yes 

(2) Probably yes 

(3) Probably not 

(4) Definitely not 
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Community Impact: Service 

J-1 Institution's participation In community affairs 
J*2 Community participation In an Institution's social, 

cultural, and recreational programs 
J-3 Community use of Institutional facilities 
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J-1 

MEASURE 
NUMBER 



EASURE NAME 



Institution's participation In community affairs 



rPINITION 



The number of faculty » staff, and students who participate In various types 

of off-campus activities In the community, such as workshops, consulting, or giving 

lectures. 



)ATA SOURCES 



Heads of departments or organizational units In the Institution, faculty, 
current students 



>ROCEDIJRES 



Administration of a Survey Questionnaire 



COMMENTS 



This outcome measure is identified as a proxy measure of an institution's :| 
contribution to the community through services provided^by the faculty, », ! 
staff, and students to various community groups and organizations. See 
outcome variable Extension Services (3.2.0.01), Personal Services (3.2.0.02), 
and Extramural Cultural and Recreational Services (3.2.0.03) in the NCHEMS 
Inventory of Higher Education Outcome Variables and Measures— see Appendix A. 
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ACQUISITION PROCEDURES FOR OUTCOME MEASURE J-1 

Two alternative procedures are suggested for obtaining data about the extent to 
which persons in the institution (faculty, staff, and students) participate in. 
various kinds of community activities. The first procedure attempts to identify 
the extent of participation iti community activities by faculty, staff, and/or 
students as a result of an institutional assignment. 

The second alternative for obtaining data for outcome measure J-1 involves the 
administration of a faculty activity analysis survey. Both procedures, as 
presented here, have major ^imitations. The major deficiency of the first 
procedure is that it does not identify those community activities in which 
faculty, staff, and students participate on a voluntary basis. The major 
limitation of the faculty activity analysis procedure is that it is restrict- 
ed to faculty activities. 

Procedures for a FACULTY. STAFF, and STUDENT COMMUNITY ACTIVITY SURVEY 
Questionnaire 

[SEE FOLLOWING PAGE] 
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INSTRUCTIONS: The following questionnaire items are to determine 
the extent to which persons associated with your department or 
organizational unit have participated in various community activities 
(e.g., consulting, art performance, lectures or seminars for the public, 
internships, work study, and policy development) during [Period of Time]. 



1 . Your name: 



2. The name of your department or organizational unit: 



3. Has your department or organizational unit assigned, sponsored, or 
co-sponsored the participation of any of your faculty, staff, and/or 
students in community activities during [Period of Time]? 

(1) Yes (60 TO QUESTION 4) 

(2) No (SKIP TO QUESTION _) 



4. Please identify. in the spaces below: (1) the name of the activities 
or events in which these individuals have participated and[ (2) 
estimate the number of faculty, staff, and/or students who participated 
in each. 



Name or Description of Activity 


Number of: 


Facul ty 


Staff 


Students 


1. 








2. 








3. 








4. 








5. 








6. 









THANK YOU FOR YOUR ASSISTANCE 
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Procedures for a FACULTY ACTIVITY ANALYSIS Questionnaire 



If this alternative is chosen, it is believed that the user will wish to 
identify faculty activity as it relates not only to community service acti- 
vities, but also to teaching, scholarship, and internal service activities. 
Therefore, it is recommended that the user consider implementation of the 
Faculty Activity and Outcomes Analysis (FAOA) survey procedures which have 
been developed by NCHEMS (Manning and Romney, 1973). These procedures have 
been designed to collect activity data that should be useful for a variety 
of institutional planning, management, and evaluation functions. 

In the FAOA survey instrument. Section D, Public Service Activities, is for 
those activities faculty engage in principally outside the institution. For 
example, the following activities would be included: 

- consulting 

- giving professional advice 

- directing or participating in community training 

- urban extension 

- giving lectures or seminars for the general public 

- patient care 

- agricultural extension 

For the users' s information, a copy of the FAOA questionnaire follows. Section 
D of the questionnaire concerns faculty Public Service Activities. 
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FACULTY ACTIVITY 
AND OUTCOME SURVEY 



Name Date Academic Term 

Please address any questions to - Phone. 

Upon completion, please detach the form and send it to : 



Purpose of Survey 



Use this space for describing the 
purpose of the survey and how the 
collected data will be used. 
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PLEAS! READ THE INSTRUCTIONS ON PAGES Z AND 5 BEfiORE'VOU COMPLETE THE FORM. 
A umph form is included on paies 6 and 7. 

GENERAL INSTRUCTIONS 

Thii survey ttks you to estimate the averaie houn per week that you spend this term engnied in different types of aclivity. 
It then asks you to estimate the percentaie contribution of ihe» hours to the outcomes of the institution, f tease read the 
•civity definitions and examptes for each activity as you comptete the survey. 

/ ■ • - 

Before completing the form, you might find it helpful to make nn initial estimate of the average number of hours you spend 
each week in this term engaged in professional activities. Making this estimate might help you divide your time into tht re* 
mainifig sections of the survey instrunwnt. 



SECnm A: TEACHING ACTIVITIES 

A«l Schcduted Teaching: All activities related to courses (degree and nondegree, credit and noncredit. day or evening) given in the 
current term. These activities would include: 

Meeting informally with Reading student papers 

course participants _ , . 

Superviaing teachmg 

Supervising these courses assistants 



Supervising independent 
study 



Meeting scheduled classes Tkitorinf 
Gradiflf 

iMtovctioM for CotaMM (a) tfMmigll Q) 

(a) Do not comptete this column. This column will be used to 
assign ■ discipline code to each course. 

(b) Enter the department, college, or other unit designation 
under w^ich the course is taught. 

(Q) Enter nhe number or other designation for tht course and 
section. 

(d) Enter the number of students enrolled and code (R) if 
course material is remedial (below coltege level) or (E) 
if it is extension (principally directed toward nonmatricu- 
lated students). 

(t) Enter the number of student credit houn given for course. 
In the cas« of variabte credit, give the credit hour range. 



Giving remedial help 
to course participants 

Supervising laboratortes 



Evaluating students 
Contacting guest lectureis 
Preparing lectures 
Preparing media 



(f) Enter the method of instruction as coded below. When 

multiple methods are used, list them in order of import* 
ance. 

(t) Enter the scheduted contact hours/week. 

(h) Enter the average hours/ week of unscheduted contact with 
students in course. 

(i) Enter the average hours/ week spent in preparing and ar- 
ranging the activities of the current course. 

(i) Enter the total average hours/week [sum of columns 
(g). (h). and (t) in Sectinn A.I]. 



MiolIwlnKtlMCol 


Hia(0 


Coda 


Method 


A 


Lecture 


B . 


Laboratory 


C 


Recitation/Discussion 


D 


Seminar 


E 


Independent Study 


F 


Tutorial 


G 


Programmed Instruction 



Definition 

Formal present ation--~primarily one-way communication 
Instructing, preparing, and supervising student investigations 
Two*way communication of course materials 
Students carry the major responsibility for preparation 
Students work independently with only minimal faculty direction 
Students work one*to*one with tht Instructor 
Course contents presented through programed materials 

A«2 Unscheduted Teaching: Teaching not associated with the specific courses listed in A.I. For exampte: 

Thesis committee participation Guest tecturing in another faculty member's course 

Thesis advising Giving seminars within the institution 

Discussions with colkagues about teaching 

AtS Academic Program Advising: Giving advice to students concerning course scheduling and academic programs. Not to be confused 
with counseling that is included in C.I. 

AA Course and Curriculum Research and Development: Developing ond preparing for future courses. For example: 



Preparing course outlines 
Developing book lists 
Evaluating courses 



Lcvtl Coica CotaMS (p) 



A 
B 

C 
D 



Description 
Preparatory' 
Lower division ' 
Upper division 
Undergraduate 



Devising new instructional materials 

Revising existing materials 

Planning summer or tntersession 
programs 

Cod^ V Z 
E 
F 
G 
H 



Developing department 
curriculum requirements 

Evaluating teaching effectiveness 
and planning changes 



Description 

Upper division and graduate 

Graduata 

Professional 

Other 
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OUTCOME DEFINITION 

TMt vccHoii of the form illows you to indicate what outcomci your activitkf principally benefit. Heaie try to make a roiish estimate 
of Hie pcrcentaiee dktributlon for each of your actvilles to the followns outcomes: 



Ch> SMcnt Growth and Development: Reiults ami benefits of 
■ctlvlHea that contribute to enhancing personal; social, aca* 
denic and/ or career aspects of students who are restctercd 
Im the institutiofi. 

0) Development of New Knowledse and Art Forms: Results 
and benefits of activities that contribute to the development, 
•lorage,* utUtiatlon, and/ or appreciation of knowledge and 
ait hi Kociety. 



(m) Community Service and Development: Results and benefits 
of activities that contribute to educational growth in and 
provide short* or long-4erm utility to the non*academic 
community. 

(b) Inseparable Combination of (k) + (I) + (m): Results and 
benefits of activities that contribute to student growth and 
development, creation of new knowledge and art forms, and 
community service and development and cannot be sepa* 
rated. (It b preferable to separate these If possible.) 



COLUMN (O) 

(m) Do not complete this column. This column will be used to link account codes to reported activities. 
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LEVEL OF ADMINISTRATIVE AND COMMITTEE ACTIVITIES 

Code Level 

1 Dispartmcnt/Unit 

2. College/School/ Division 

3 Campuswidc 
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lUASE Head the instrijctions on this page as you complete the fokm to the left 



section B: research, SCHOLARSHIP. AND CREATF. WORK ACTIVITIES 

!•! Specific Projects: Research. NCholarship. iind crcilive work aciivily rcliiled lo .1 Hpecific project, hor example: 



Departmental research 

Sponsored research 

Perfomiinf your 
professional skill 

Your dissenatioh research 



Revewing a collea|ue*s 
research work 

Writing or developing 
research proposals 

Administering research 
grants 



Giving recitals 

Maintaining an artistic 
skill 

Writing articles 
Writing books 



Writing reviews 
Creating new art forms 
Exhibitions 



BJt General Scholarship and Professioniil Development; All research, scholarship, and creative work activities related to keeping cur- 
rent in a professional field. For example; 

F.eading articles and Officer in a professional Attending seminan Editor of a journal 

books related to your society 
profession 



Attending professional 
meetings 



Research-related discussion 
with colleagues 



SECTION C: INTERNAL SERVICE ACTIVITIES 

This section includes activities related to general contact with students, to professUinal responsibilities within other organizational 
iinttN uithin the institution, and to fulfilling insiitutonal requests, 



C<l St udent'oriemed Service; For example: 

Recruiting students 



Personal, career, and 
financial counseling 

Preparing recommendations 

Pa ntci potion in social 
interaction 



Sponsoring student organizations 
Meeting with parents 
Attending student recitals 



Coaching intramural or 
intercollegiate athletics 

Directing the band, orchestra, 
student plays, debate team, or 
any other student group 



C«2 Administrative Duties: For example: 

Performing the duties of ■ 
department chairman, dean, 
vice-president or any other 
administrative position 

Administering personnel 
policies 



Faculty service reports and 
questionnaires 

keeping records 

Preparing minutes 

Writing and answering 
memoranda 



C«3 Committee Participation, For example: 

Admission committees Faculty senate 

Departmental meetings Planning comniittee^t 



Assigning faculty course loads Escorting visitors 



Preparing btidgets 

Gathering data 

^ Helping during registration 

Interviewing candidates for 
faculty positions 

Budget committees 



Recruiting faculty 

Advising on library purchases 

Recniiting students 



Code the level of these activities as described at the foot of the form, 



SECTION D*. PUBLIC SERVICE ACTIVITIES 

This section inclttdcs activities that are directed outside the institution {except for those associated with community education 
< extension instruction), which should he included in A, I.), 

General Professional Services/ Advice Directed OiUside the Institution: Activities meant to benefit the community outside the 
institution. For example: 



Consulting 
Advising 

Professionally performing 
as in pla>s, oa'hestras 



Community training grants Agricultural extension 

Patient care Urban extension 

Lectures or seminars for 
the public 
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J-2 

MEASURE 
NUMBER 



€ASURE NAME 



Community participation in an institution's social , cultural, 
and recreational programs 



)EFINITION 



The number of persons from the community who participate in social, cultural, 
and recreational activities organized and sponsored by an institution for 
its members and the general public during a specified period of time 



DATA SOURCES 



Institutional records maintained by institutional departments or agencies 
sponsoring social, cultural, and recreational programs in whi'ch persons 
in the community participate 



PROCEDURES 



Search of Institutional Records 



COMMENTS 



This outcome measure is identified as a proxy measure of an institution's 
contribution to a community in the form of Extramural Cultural and Recreational 
Services which is Outcome Variable 3.2.0.03 in the NCHEMS Inventory of Higher 
Education Outcome Variables and Measures— see Appendix A. 
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ACQUISITION PROCEDURES FOR OUTCOME MEASURE J-2 



Data on public participation in the institution's social, cultural, and 
recreational activities can best be obtained by examining the records of 
the sponsors of such activities within the institution. For example, the 
offices of student government or student activities often maintain such 
records. The following procedural steps are suggested. 

Procedures for Use of Institutional Records 

1. Identify the time period during which the extent of public 
participation in the institution's social, cultural, and 
recreational activities wi11 be determined. 

2. Determine a11 the sponsors within the institution that have 
sponsored one or more social, cultural, „ and/or recreational 
activities within the designated period of time. 

3. Ask each sponsor to: 

a. Identify the type of activity (ies) offered (social, 
cultural, or recreational). 

b. Estimate the number of community members who participated 
in each type of activity. 

4. For a descriptive summary of the data, list the estimated number 
of community participants in each type of activity sponsored 
during the time period in focus. 
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■ J-3 

MEASURE 
NUMBER 



MEASURE NAME 



Coirmunity use of institutional facilities 



DEFINITION 



The number of persons from the community utilizing facilities maintained by 
the institution such as libraries, language labs, testing centers, computer 

5f"S«riu* services, recreation and athletic facilities, museums, and 

so forth 



DATA SOURCES 



Managers of the Institutional Facilities, Members of the Community 



PROCEDURES 



Search of institutional records or administration of a questionnaire to 
members of the community 



COMMENTS 



This outcome measure is identified as a proxy measure of the extent to which 
individuals in the community receive various types of personal services from 
/5®«^)|PR2r* P''°9''*"'^ ^"^ facilities of the institution. See Perso nal Services 
<3.2.0.02) in the NCHEMS Inventory of Higher Education Outcome Variables and 
Measures in Appendix A. 
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ACQUISITION PROCEDURES FOR OUTCOME MEASURE J-3 

• ■ , ■ 

The extent to which community members use the educational or support facil- 
ities in an institution can be determined either by a questionnaire survey 
of a sample of the community population or by a survey of those persons in 
the community. As a result, two alternative procedures have been developed 
for obtaining data for this measure. 

Procedures for a Facility Use Questionnaire Survey 

Alternative #l~Survey of Facility Managers: 

1. Select the time period during which the number of persons 
from the community using the institution's educational and 
support facilities will be determined. 

2. List the facilities that are to be included in the study. 

3. Identify the persons in charge of each facility (or who are 

in the best position to provide the information that is needed). 

4. Administer the following "Facility Use Questionnaire" to 
each of the persons identified in 3 above. If a person is 
responsible for more than one facility, that person should 
complete a separate questionnaire for each facility. 

Alternative #2— Survey of Community Members: 

The followinli questionnaire item is designed to obtain self-reports from 

persons in the community to two questions concerning facility use: 

(1) Do persons in the community know about certain institutional facilities 
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FACILITY USE QUESTIONNAIRE 



The purpose of this short questionnaire is to help us determine the extent 
to which persons from the community make use of the facilities maintained 
by [Name of Institution]. Your cooperation in completing the questionnaire 
is most appreciated. Please return it to [Location] by [Date]. 



1. Your Name: 2. Date: 



3. Address: 



4. Telephone Number: 



5. Please fill in the following table by estimating, as best you can, the 
number of persons from the community who have used this facility or 
have attended certain events, activities, etc. held in the facility for 
which you are responsible during [Period of Time]. 



Official Name of Facility: 



Name or Description 
of Events or 
Activities 



* Estimated 
Number of 
Community 
Attendees 



Please give a brief 
description of how 
you made your estimate. 



£3^ 
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being available to them? and (2) How many of those persons have used the 
facility or attended or participated in events held in the facility? In 
using this item, it will be necessary to develop a list of the individual 
facilities (health centers, libraries, counsel ing-developmental centers, 
computer centers, gymnasiums, and so forth) to -which persons will be asked 
to react in the survey. Also, it will be necessary to determine the 
time period in which the respondent will identify if he or she used, the 
facility. 
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1/ 



The purpose of this questionnaire item is to help us learn about the 
extent to which persons in the community "know about" and "make use 
of" various facilities at [Name of Institution]. For each facility 
listed in the left-hand column^ please answer questions "A" and "B." 



Name of 
Facility 



Question "A" 

Check (/) each box 
below if you were 
aware, prior to 
receiving this 
questionnaire, that 
the facility was 
open to the public. 



Question "B" 

Check (/) each box 
below if you have 
used or have attended 
or participated in an 
event at the facility 
during the last six 
months. 



NOTE: 



The time period in Question"B" can be changed based on 
the purpose of your study. 
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Conmunity Impact: Economic 



K-1 Institution's payment of local taxes and state taxes 

and tax compensation 
K-2 Institution's purchase of locally provided utilities 
K-3 Institution's purchase of locally delivered goods 

and s^vices 

K-4 Institution's capital equipment expenditure relevant 

to the local community 
K-5 Institution's capital construction expenditure relevant 

to the local community 
K-6 Local expenditures by faculty and staff 
K-7 Local expenditures by students 
K-8 Local expenditures by visitors 



180 

203 



NATIONAL CENTER FOR HIGHER EDUCATION MANAGEMENT SYSTEMS 
Outcome Measures and Procedures Manual 



K-1 

MEASURE 
NUMBER 



1EASURE NAME 



Institution's payment of local and state taxes and tax 
compensations 



)EFINITION 



All local taxes and tax compensations (payment made in lieu of taxes), 
that an institution pays to local governments (e.g., city, county, state) 
including school districts, towns, cities, counties, and so forth 



DATA SOURCES 



Institutional Business Office 



PROCEDURES 



Search of Institutional Records 



COMMENTS 



This outcome measure is identified as a potential measure of the institution's 
Financial Impact on the Community (3.2.0.04) in the NCHEMS Inventory of 
Higher Education Outcome Variables and Measures— see Appendix A. 

Most educational institutions are free from local tax assessments except for 
an institution's commercial or related activities. However, 
exceptions do occur. For example, some institutions may enter'an agreement with 
the local government to pay certain amounts in order to compensate for the eroded 
tax-1)ase due to their presence in the community. 
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ACQUISITION PROCEDURES FOR OUTCOME MEASURE K-1 

The data for outcome measure K-1 can be obtained through a search of insti- 
tutional records, generally maintained in the institution's business office. 

Procedures for Use of Institutional Records 

1. Identify the period of time during which data for the 
measure will be examined. 

2. Contact the chief business officer in the institution 
and determine: 

a. If the institution paid any locally assessed taxes 

during the time period in focus. If so, the following 
table should be completed: 



Type of 
Taxes Paid 


Name of Local Governments 
To Which Taxes Were Paid 


Amount Paid 


Property Tax 






Sales Tax 






Income Tax 






Other (please 
specify) 






TOTAL: 
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b. If the institution paid or donated any amount of dollars 
to the local govemment(s) in lieu of taxes (for example, 
in compensation for the eroded tax base) during the time 
period in focus, the following table should be completed: 



Type of Payments 
or Donations 


Name of Local Governments 

To Which Payments or 
Donations Have Been Made 


Amount 
Paid 








TOTAL: 
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K-2 



MEASURE 
NUMBER 



lEASURE NANE 



lEFINITION 



Institution's purchase of locally provided utilities 



Total amount of dollars expended on utilities (such as gas, electricity, qarbaqe 
collection, sewage treatment) which were purchased from the local community 
during a certain time period ' 



)ATA SOURCES 



Institutional Business Office 



PROCEDURES 



Search of Institutional Records 



:OMMENTS 



This outcome measure is identified as a potential measure of the institution's 
Financial Impact on the Community (3.2.0.04) in the NCHEMS Inventory of Higher 
Education Outcome Variables and Measures—see Appendix A. 
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ACQUISITION PROCEDURES FOR OUTCOME MEASURE K-2 



Most institutions pay standard rates for locally provided utilities and the 
payments generally are made by the business office. Therefore, cost data on 
utilities purchased from the local community should be obtainable by simply 
searching the institution's utility payment records. 

Procedures for Use of Institutional Records 

The following procedural steps are suggested for obtaining the total dollar 
figure for locally provided utilities: 

1. Identify the time period during which the amount of 
dollars expended on locally provided utilities will be 
determined. 

2. Determine the boundary of the institution's functional 
local community . \ 

3. Identify the types of utilities that have been purchased from 
the defined local commur#ty. 

4. Tabulate payment figures by using the following format: 

1 
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Type of 
Utility 


Name and address of the businesses in the 
local community from which utilities 
have been purchased 


Amount of 
Dollars 








TOTAL: 
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K-3 



MEASURE 
NUMBER 



EASURE NAME 



Institution's purchase of locally delivered goods and services 



EFINITION 



Total amount of dollars expended on goods and services that are purchased by the 
institution from the local community during a certain time period. Goods and 
services are distinguished from capital equipments generally defined by each 
institution in terms of dollars and duration (see COMMENTS). Also, goods and 
services, as referred to here, do not include utilities purchased from the 
local community (see Outcome Measure K-2) 



)ATA SOURCES 



Institutional Business Office 



PROCEDURES 



Search of Institutional Records 



:OMMENTS 



This outcome measure is identified as a potential measure of an institution's 
Financial Impact on the Community (3.2.0.04) in the NCHEMS Inventory of Higher 
Education Outcome Variables and Measures— see Appendix A. 

In separating "goods and services" from "capital equipment" each institution 
uses different criteria of dollars and duration. The user of the manual should 
consult the institution's business office to determine the criteria for 
distinguishing goods, and services from capital equipment. 
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ACQUISITION PROCEDURES FOR OUTCOME MEASURE K-3 



Considering the potential diversity In purchasing methods and record keeping 
among Institutions, It Is expected that users of the manual w111 have to 
make several decisions during the course of gathering the data for this measure. 
For the purpose of clarifying the process of searching Institutional records 
to obtain the desired Information, a simple flow chart Is presented In 
Figure K-3.1 on the next page, the user may consult the Information search 
process suggested In the figure and make a general plan applicable to his 
or her particular situation prior to engaging In the data collection activity. 
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Figure K-3.1 

INFORMATION SEARCH PROCESS FOR OUTCOME MEASURE K-3 



/ 



SEARCH A. 
_>i INSTITUTIONAL RECORDS 
(START) 




ASSEMBLE THE | 
FIGURES BY i4 
LOCAL ADDRESS 



ASSEMBLE THE 
FIGURES BY 
LOCAL 
ADDRESS 



AGGREGATE 
THE FIGURES 
FOR 

ALL UNITS 



OUTPUT 



.--^TAL AMOUNT OF DOLLARS' , 
SPENT FOR LOCALLY DELIVEREt 
GOODS AND SERVICES 
(END) 
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Procedures for Use of Institutional Records 

1. Identify the time period during which the total amount of dollars 
expended on goods and services that are purchased by the institution 
from the local community are to be determined. 

2. Determine the boundary of the institution's functional local 
community , 

3. Consult the institution's business office to determine whether the 
purchasing activity of the institution is carried out by a central 
purchasing office or by subunits ( departments and other 
organizational units) within the institution. 

4. ^-f the purchasing activity is centralized^^ determine whether the 
purchasing records contain the addresses of the suppliers in the 
designated local community. If they do, it is simply a matter of 
retrieving the information according to the planned format. If, 
however, the record files do not contain the local supplier's 
addresses, the user of the manual will have to obtain such infor- 
mation from the existing files that contain the vendor register 
or invoice vouchers. 

If, by chance, the user attempts to use an aggregate figure that 
already has been developed by certain offices, care should be 
taken about the reliability of that information. For example, 
the user might check the aggregate information against the 
original data or check the information generated by one office 
against that generated by another office. 
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If the purchasing activity Is not centralized or the needed 
information is not centrally available, the following steps 
should be taken: 

a. Consult the Institution's business office and Identify 
a11 purchasing units within the Institution. ^ 

b. Contact the person In charge of each purchasing unit's 
expenditure records and obtain the needed Information 
for deriving the measure. 

Calculate the total amount of dollars paid by each purchasing 
unit In the Institution to suppliers In the designated func*- 
tlonal local community within the specified time period. 
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K-4 

MEASURE 
NUMBER 



1EASURE NAME 



Institution's capital equipment expenditure relevant to the 
local community 



)EF1NITI0N 



Total amount of dollars expended in the local conmunity by institutions as a 
result of an institution's capital outlay expenditure. Capital outlay is usually 
defined in terms of a "good" with the cost exceeding (1) a certain amount of 
dollars and (2) the duration of useful life of the "dood" years. The criteria 
may vary somewhat among institutions. (See COMMENTS) 



DATA SOURCES 



Institutional Business Office 



PROCEDURES 



Search of Institutional Records 



COMMENTS 



This outcome measure is identified as a potential measure of an institution's 
Financial Impact on the Conmunity (3.2.0.04) in the NCHEMS Inventory of Higher 
Education^^autcome variables and Measures— see Appendix A. 

The user of this procedure is advised to follow the definition of "capital outlay" 
used by the institution. Although the criteria may vary somewhat among institutions, 
the margin of error will be much less significant than that stenming from imposing 
a new definition which would inevitably disrupt the standard operating procedure 
developed in each institution. 
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ACQUISITION PROCEDURES FOR OUTCOME MEASURE K-4 



In obtaining the data on the total amount of dollars expended in the local 
community by the Institution for capital equipment, the user should consult 
the Institution's business office and apply the same Information search 
procedures as that developed for outcome measure 

» 

As pointed out earlier (see procedures for outcome measure K-3), "capital 
outlay" is distinguished from "goods and serivces" for expenditure analysis 
purposes. A conceptual distinction is therefore made in the definition of 
outcome measure K-4. 
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K-5 



MEASURE 
NUMSER 



EASURE NAME 



Institution's capital construction expenditure relevant to the 
local community 



EFINITION 



Total amount of dollars expended In the local community by an Institution as a result 
of Its capital construction expenditure. The capital expenditures Include (1) 
purchase of land, (2) land Improvement, (3) construction (building and parking lot), 
(4) building repair and Improvement, (5) architect's fees, and (S) others that are 
specifically designated by each Institution as "capital construction." 



lATA SOURCES 



Institutional Business Office 



PROCEDURES 



Search of Institutional Records 



:OMMENTS 



This outcome measure Is Identified as a potential measure of an Institution's 
Financial Impact on the Community (3.2.0.04) in the NCHEMS Inventory of Higher 
Education Outcome Variables and Measures—see Appendix A. 
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ACQUISITION PROCI-DURES FOR OUTCOME MEASURE K-5 



It should be pointed out at the outset that the complexity of the data acqui- 
sition procedures for outcome measure K-5 is dependent upon the level of detail 
the user wishes to explore regarding capital expenditure. For instance, the 
institution may contract with a firm that in turn may subcontract with other 
firms. Therefore, the original contractor may disperse its capital over several 
localities through a subcontract process. The potential complexities involved 
in this process suggest that for analytic purposes some constraints must be placed 
on the level of detail associated with the flow of an institution's capital 
expenditures out to the designated functional local conmunity. 

The following procedure calls for examination of only those capital 
expenditures associated with the original contracts arranged between the 
institution and the local firms. In addition, it is recommended that 
the focus be limited to the original amount of dollars specified in the 
contract. 

Procedures for Use of Institutional Records 

The following procedural steps are designed to obtain that portion of an 
institution's capital dollars that are spent in the local designated func- 
tional conmunity: 

1. Identify the period of time in which the capital expenditures 
in the local community are to be examined. 

2. Determine the boundaries of the functional local community . 



O . 136 

222 



Consult the institution's business office to examine the 
institution's State of Changes in Fund Balance and its 
supporting documents . 

The Statement of Changes in Fund Balance shows the total amount 
of capital expenditures including the major components over a 
given year. It does not, however, provide the localities in 
which the capital budget has been spent. The supporting doc- 
uments wi11 show in detail from whom the land was purchased, 
if any, what specific projects were financed, and to whom 
contracts were awarded. 

Examine carefully the supporting documents and identify for 
each project (or fiscal transaction): 

a. The address(es) of the firm(s) (or individuals) from 
which land was purchased, if any; 

b. The address(es) Of the finn(s) to which contracts were 
awarded; and, 

c. The amount of dollars associated with each financial 
transaction. 

Select the projects and the firms located in the designated 
local community. 

The following table is suggested for organizing the capital 
expenditure data: 
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Type of cdDital 
expenditures 


Name of the localities 
in which canita! huHapt 
is spent 


ninuUil U U 1 

dollars 








TOTAL: 
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S 

K-6 

MEASURE 
NUMBER 




1EASURE NAME Local expenditures by faculty and staff 


)EFINITION 

Total e 
spend 1 


tmount of dollars that the faculty and staff in an institution 
in the local comnunity during a certain period of time 


}ATA SOURCES 

Institutional Faculty and Staff 


PROCEDURES 

Adminis 


stration of a Survey Questionnaire 


COMMENTS 



This outcome measure is identified as a potential measure of an Institution's 
Financial Impact on the Community (3.2.0.04) in the NCHEMS Inventory of Higher 
Education Outcome Variables and Measures— see Appendix A. 
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- a^"- ACQUISITION PROCEDURES FOR OUTCOME MEASURE K-6 

The set of questionnaire Items developed for obtaining the data needed for 
outcome measure K-6 Is a modification of a group of the Items used In a 
recent community Impact study conducted by the Office of the Vice-President 
for University Relations at the University of Colorado (Rautenstraus, 1974). 
The Items have been modified with the permission of the author of the study 
report. 

Procedures for a FACULTY and STAFF Questionnaire 
[SEE FOLLOWING PAGE] 
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The following items are Intended to Kelp In estimating the economic 
impact of [Name of Institution] on the local community ^ 

1. What Is your primary employment status at [Name of Institution]? 

(1) Full-time Faculty 

' (2) Part-time Faculty 



(3) Full -time Staff 

(4) Part-time Staff 

2. Approximately how far do you live from capious? (Please write In the 
space below the estimated number of miles.) 

Miles 



3. In what type of housing do you reside? 
0) Rent 

{2) Own home 

4. Please estimate your average monthly expenditures In the folowing 
categories: [NOTE: These estimates will be strictly confidential.^ 

Rent or house payment $ 

Utilities (water, gas, electric, telephone, disposal) . . $ 

Food and beverages . • • • $ 

Real estate and other local taxes $ 

Automobile (payment, repairs, gas. Insurance) $ 

Charitable donations $ 

Cleaning and laundry. $ 

Clothing $ 

Entertainment $ 

Furniture 

Health (Include dental and Insurance) ..... $ 

Insurance (except auto and health) $ 

Local public transportation $ 

Magazines and newspapers $_ 

Personal Items $_ 

Miscellaneous $ 

TOTAL $ 



5. What is your yearly expenditure for books and educational 
supplies? $ 
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K-7 



MEASURE 
NUMBER 



1EASURE NAME 



Local expenditures by students 



EFINITION 



Total amount of dollars that students spend in the local community during 
a certain period of t4lTie 



DATA SOURCES 



Current Students 



PROCEDURES 



Administration of a Survey Questionnaire 



COMMENTS 



This outcome measure is identified as a potential measure of an institution's 
Financial Impact on the Community (3.2.0.04) in the NCHEMS Inventory of Higher 
Education Outcome Variables and Measures— see Appendix A. 
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ACQUISITION PROCEDURES FOR OUTCOME MEASURE K-7 

The set of questionnaire items developed for obtaining the data needed for 
outcome measure K-7 is a modification of a group of the items used in a 
recent community impact study conducted by the Office of the Vice-President 
for University Relations at the University of Colorado (Rautenstraus, 1974). 
The items have been modified with the permission of the author of the stu4y 
report. 

Procedures for a CURRENT-STUDENT Questionnaire 
[SEE FOLLOWING PAGE] 
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The following questions are intended to help us ledrn about the economic 
impact students at [Name of rnstitution] have on the local community . 

1. What is your student status at [Name of Institution]? (PLEASE CHECK ONE) 
0 ) Freshmen \ ( 4) Senior 

(2) Sophomore (5) Graduate 

i^) Junior ' (e) Special 

2. Are you currently a full-time or part-time student? 

0) Full-time student (2) Part-time student 

3. Approximately how far do you live from campus? (Please write in 
the space below the estimated number of miles.) 

Miles 



4. In what type of housing do you live? (PLEASE CHECK ONE) - 

0) Campus housing {^) Fraternity or Sorority 

(2) Rent {5) Live with parents 

{^) Own home 

5. Please estimate your average monthly expenditures in the folowing 
categories: [NOTE: These estimates will be strictly confidential.'} 

Rent or house payment $ 

Utilities (water, gas, electric, telephone, disposal) ] ! $~* 

Food and beverages | — 

Real estate and other local taxes . ! ! $ 

Automobile (payment, repairs, gas, insfurance) $ 

Charitable donations $ 

Cleaning and laundry ! ! ! ! $ 

Clothing ! ! ! . $' 

Entertainment !!!!!!!! $ 

Furniture ! ! ! ! ! $ 

Health (include dental and insurance) $ 

Insurance (except auto and health) [ $ 

Local public transportation $ 

Magazines and newspapers. . . ! 

Personal items [ [ $ 

Miscellaneous , , $ 

total' * $ 

6. What is your yearly expenditure for books and school supplies? $ 

Tuition and fees? $ 
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K-8 

MEASURE 
NUMBER 



MEASURE NAME 



Local expenditures by visitors 



DEFINITION 



A total amount of dollars that visitors to an Institution spend in the local 
community during a certain period of time 



DATA SOURCES 



Faculty, staff, students, ^^nd academic units, (such as departments and institutes) 
and visitors ' 



PROCEDURES 



Administration of a Survey Questionnaire 



COMMENTS 



This outcome measure is identified as a potential measure of an institution's 
Financial Impact on the Community (3.2.0.04) in the NCHEMS Inventory of Higher 
Education Outcome Variables and Measures— see Appendix A. 
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ACQUISITION PROCEDURES FOR OUTCOME MEASURE K-8 



Administration of a survey questionnaire Is suggested for obtaining an 
estimate of the total amount of dollars that visitors at an institution 
spend in the designated functional local community during a given period 
of time. 

Three alternative sets of questionnaire items have been developed for 
consideration. The first set is appropriate for administration to fac- 
ulty, staff, and students. The second set is designed to be administered 
to the heads of departments or other organizational units in the institu- 
tion that have sponsored activities attended by visitors from outside the 
designated functional local community. The final set of items is designed 
to be administered directly to visitors. 

Procedures for VISITOR-EXPENDITURE Questionnaires 

[SEE FOLLOWING PAGE] 
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Alternative #1: Facul ty/Staff /Student Questionnaire 



FACULTY/STAFF/STUDENT QUESTIONNAIRE 



INSTRUCTIONS: The following survey questionnaire is intended to learn 
how much money your non-local visitors have spent during [Period of Time] 
in [Name of the local community]. For each type of visitor identified 
below, please give your best estimates about (1) the number of non-local 
visitors you have had during [Period of Time]— count each visitor's visit 
as one visitor; (2) the average length of their stay— count days; and 
(3) the average amount of their daily spending. 





1 


2 


3 


4 


Type of non«*1oca1 
visitors 


Number of 
Visitors 


Average length 
of their stay 


Average 
daily local 
expenditures 


Sum = 1x2x3 
(Do not write 
in this column] 


Parents & Relatives 

Friends 

Professional 
Colleagues 

All Others 




( ) Days 
( ) Days 

( ) Days 
( ) Days 


$ 






$ 




$ 




$ 






Grand Total 


//a 
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Alternative #2: Organizational Unit Questionnaire 



ORGANIZATIONAL UNIT QUESTIONNAIRE 



INSTRUCTIONS: The following survey questionnaire is designed to estimate 
the amount of local expenditures that have resulted from the non-local 
visitors who have participated in meetings (or conferences) tnac your 
organization has sponsored during [Period of Time].* 



1. 
2. 
3. 



Your name 



Name of your department_ 



During (period of time) has your department (or organization) 
sponsored any activities, meetings, or conferences, etc. that 
were held in [Name of the Local Community] and in which 
visitors outside the community participated? 

1. YES, we have. (Go to Question 4) 

2. NO, we have not. 



4. Please identify the nature (or name) of meetings and make your best 
estimate in the categories that follow: 





1 


2 


3 


4 


Nature (or name) 
of activity 


Number of 
days activity 
lasted 


Estimated 
number of 
non-local 
participants 


Estimate 
Average Daily 
local expenditures 
of participants 


SUM = 1x2x3 
(Do not write 
in this column) 
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*In some instances, the user may wish to account for visitors who come to the 
coinnunlty for conferences, workshops, etc. that are held in campus facilities 
which are not sponsored, by IHE. PQ'^;' 

236 , 



Alternative #3: Visitor Questionnaire 



The following questionnaire has been developed as an alternative for iden- 
tifying the amount of nroney spent by visitors to the local community. The 
items in the questionnaire are modified versions of items used in a recent 
community impact study conducted by the University of Colorado (Rautenstraus, 
1974). They have been modified for inclusion in this manual with the per- 
mission of the author of the University of Colorado community impact study 
report. » 

Various formats and procedures for administering the questionnaire to visitors 
can be used. The one recommended here calls for (1) printing the INTRODUCTORY 
REMARKS and questionnaire items on one side of an 8 1/2 x 11 inch piece of 
paper and (2) printing the return address and a first class business reply 
mail permit on the other side of the paper. 
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Alternative #3: Visitor Questionnaire 



VISITOR QUESTIONNAIRE 

WELCOME! The [Name of Institution] hopes thay you have a good time In 
[Name of Community]. The [Name of Institution] Is conducting a survey 
to determine how much a visitor spends In [Name of Community]. When 
your visit Is completed, please fill out this questionnaire and return 
It to us. 

To return the questionnaire, please refold and staple the questionnaire 
so that the top third Is covered by the bottom third and the [Name of 
Institution] address and prepaid postage notice Is shown. 

Thank you for your helpl | ^ 

1. How far did you travel to come to [Name of Community]? Miles 

2. How long did you stay In [Name of Community]? Days 

3. What were your expenditures In [Name of Community] In the following 
categories? 

Food (off -campus) $ 

Lodging $ 

Other (souvenirs, gas, etc.) $ 

4. Was your primary reason for visiting [Name of Community] related to 
the [Name of Institution]? 

Yes 

No 

5. Please check (/) the [Name of Institution] activities that you 
attended during your stay: 

Seminar Film 

Conference Museum 

Forum Athletic Contest 

Workshop Social Event 

Lecture Other 

Concert Visit with son/daughter 

attending [Name of Institution] 
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On the other side of the questionnaire print the return address and the 
business reply mail permit so the respondent can easily fold and staple 
the questionnaire. An example of what the other side of the questionnaire 
might look like is presented on the next page. 

Obviously, other formats could be used for developing this type of visitor 
questionnaire. A good person to consult is a graphic arts specialist. 
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BUSINESS REPLY MAIL 

NO POSTAGE NECESSARY IF MAILED IN THE UNITED STATES 



POSTAGE WILL BE PAID BY- 



[Name of Institution] 

[Address to Which Questionnaire 
Is to be Returned] 



FIRST CLASS 
PERMIT NO. 
BOULDER. COLO. 




r 
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APPENDIX "A 

INVENTORY OF HIGHER EDUCATION OUTCOME VARIABLES AND MEASURES 
[Extracted from Micek and Wa11haus, 1973] 
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THE 

INVENTORY OF HIGHER EDUCATION 
OUTCOME VARIABLES AND MEASURES : 
AN OVERVIEW 

The Outcomes of Higher Education project of the National Center for Higher 
Education Management Systems at WICHE hopes to make significant contributions 
to solving the problems associated with identifying and using outcome infor- 
mation in planning and management. NCHEMS's first effort has been an attempt 
to develop an inventory of possible outcome variables with suggestions for 
their measurement. The sections that follow describe the inventory and its 
use. 

Development of the Inventory 

One major problem associated with incorporating the outcomes of higher education 
into planning and decision making processes has been the lack of a "common outcomes 
language" necessary for communicating and understanding the outcomes and benefits 
of higher education programs. To some degree this situation parallels the 
difficulties biologists faced prior to the development of Linneaus's taxonomy, 
which provided a common language or inventory for identifying and categorizing 
the various hierarchies of living organisms. Once the taxonomy was completed, 
however, biologists were in a better position to identify, measure, and analyze 
the characteristics and changes of the various species. Consequently, their 
knwoledge about plant and animal organisms increased, and their communication 
about these organisms with other scientists improved. 



ERIC 



216 

245 



Similarly, higher education has difficulty communicating about benefits or 
results. Barriers are encountered_when attempts are made to translate goal 
statements into terms of program outcomes, and program comparisons are thwarted 
because structures, definitions, and measures are lacking. While developing 
a comuuni cation base for higher education outcomes is by no means a total or 
final solution, it is a necessary step. Recognition of the potential benefit^ 
of such a communication base has led NCHEMS to develop the Inventory of Higher 
Education Outcome Variables and Measures . This inventory lists and describes 
various outcomes of higher education and suggests potential measures or proxy 
measures of those outcomes.* 

Basic to the inventory are two criteria. The first criterion is that the 
inventories must be of service to as many kinds and levels of planners and 
decision makers in higher education as possible. For example, they should 
aid students and parents in making better decisions about which institutions 



*NCHEMS also has developed an Inventory of Institutional Environment Variables 
and Measures that includes various combinations of resource measures, finan- — 
ciai measures, activity measures, and target and beneficiary group measures. 
The development of this inventory recognizes that institutions do design 
programs and allocate resources to produce certain important environmental 
outcomes. For example, institutions of higher education create programs and 
allocate resources to develop certain types of facilities that will promote 
a unique intellectual and/or social atmosphere. While the creation of this 
unique atmosphere may be a desired outcome, it is pursued with the belief that 
It will eventually contribute to better student learning, better research, or 
better service for the students and the community in general. In addition, 
environmental measures can be used as meaningful proxies for outcomes, if the 
outcomes cannot be measured directly. For example, the number of library 
volumes acquired per student. may serve as a proxy measure of student growth 
and development. 

For your information, drafts of this inventory are available upon request. 
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and programs will provide the most meaningful and appropriate educational 
experiences. They should help institutional administrators and program 
managers account for the educational resources allocated and utilized in 
terms of the outcomes and benefits produced and the goals attained. Finally, 
they should provide legislators and statewide coordinating agencies with a 
better understanding of the intended as well as the unintended consequences 
of higher education. 

The second criterion employed in developing the inventory is that it must 
provide a relatively complete characterization of an instituion's programs. 
The variables listed in the outcomes inventory should include not only 
academic and instructional outcomes, but research and community service 
outcomes as well. 

The inventory has been developed to include comprehensive lists of the 
outcome variables related to hif|her education programs and institutions. 
For the purpose of clarification, a variable in the context of the inven- 
tory is defined as some entity or quality capable of assuming one of a 
number of quantitative or qualitative values. For each outcome variable, 
the inventory presents a definition or pertinent description, and it 
suggests a list of potential measures^ that can provide the appropriate 
evidence or necessary data for assessing the designated variables. 

The current outcomes inventory incorporates reactions and suggestions from 
many individuals concerned with higher education. The following major 
categories define the structure of the inventory. 
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Section 1.0: 
1.1.0: 
1.2.0: 
1.3.0: 
1.4.0: 
Section 2.0: 
Section 3.0: 
3.1.0: 
3.2.0: 
3.3.0: 



Student Growth and Development Outcome Variables 
Knowledge and Skills Development 
Social Development 
Personal Development 
Career Development 

Development of New Knowledge and Art Forms Outcome Variable 

Community Development and Service Outcome Variables 

Community Development 

Community Service. 

Longer Term Community Effects 



Characteristics of the Inventory 



The outcomes inventory can be further described by identifying certain key 

characteristics and limitations. 

Com prehensiveness : While every attempt has been made to develop 
a comprehensive list of variables, it is highly probable that 
certain important outcome variables have been overlooked. Or, 
more likely, in certain cases the descriptions may be interpreted 
to exclude elements they are intended to encompass. 

It is recognized also that different individuals, institutions, 
and agencies will establish different subsets of the variables 
they view as relevant. Such lists undoubtedly will eliminate 
certain variables, which will simply emphasize the fact that 
different individuals, institutions, and agencies have unique 
sets of objectives. 
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Disaggregation ; If an attempt is made to map the inventory onto 
an institution's program structure, it may become apparent that 
incongruities exist at different levels of aggregation. For 
example, it is very difficult to associate many of the outcome 
variables, particularly those in the area of student values and 
attitudes, with any program classification below the entire campus 
except an a very arbitrary basis. A major reason for this aggre- 
gation problem is that higher education programs often produce 
joint outcomes. For example, a program in political science 
potentially affects students in terms of their "political" values 
and attitudes. Similarly, a program in history and sociology also 
can affect "political" values and attitudes. Consequently, attri- 
buting any change in students' "political" values and attitudes to 
a particular program or course is extremely difficult. 

Redundancy : While developing a list of mutually exculsive outcome 
variables has been a key concern in the development of the inven- 
tory, the overlaps between variables in the inventory have not been 
entirely eliminated. For example, student values and attitudes 
toward "change and stability" are likely to intersect with "political" 
values and attitudes. Similarly, "vocational preparation" characteris- 
tically intersects with "general knowledge" and "communication skills." 
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Neutral Scale : The variables', definitions and descriptions are 
not intended to connote value judgments. Efforts have been made 
to eliminate the use of such value-laden terms as "increase," 
"gain," and "beneift." EacK user of the inventory is expected 
to view the variable descriptions as a neutral scale, to which 
he can attach his own unique values in terms of his preferred 
evaluation standards or his desired levels of performance. For 
example, one institution may want to increase the importance its 
students attach to "socioeconomic aspirations," while another 
institution may desire to decrease the degree of emphasis placed 
on this variable. It is recognized that an implied value judgment 
is built into the inventory by virtue of the level of aggregation 
utilized. That is, since "cbmnunication skills" is listed and 
"mathematical skills" is not, the unintended implication may be 
that communication is more important than mathematics. However, 
every attempt has been made to maintain a consistent level of 
aggregation throughout the inventory. 

... «. 

Measures '. Developing a comprehensive list of outcome measures is 
a large-scale task, and it should be clear that the suggested measures 
are not all-inclusive and, for that matter, they may not be the best 
available. Thus, each user of the Inventory should strive to identify 
or develop additional measures or proxy measures to gain as much infor- 
mation as possible about the outcome variables he is interested in 
assessing. The criteria for suggesting measures are based on judgments 
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of their significance and practicality, primarily relative to data 

availability. Studies to determine the relationships between measures 

and their value, practicality, and interpretation remain to be accomplished. 
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OUTLINE OF THE INVENTORY OF 
HIGHER EDUCATION OUTCOME VARIABLES AND MEASURES 

1 .0 Student Growth and Development 

1.1.0 Knowledge and Skills Development 
1.1.1.00 Knowledge Development 

1 . 1 . 1 . 01 General Knowl edge 

1.1.1.02 Specialized Knowledge 
1.1.2.00 Skills development 

1.1.2.01 Application and Knowledge Skills 

1.1.2.02 Critical Thinking and Reasoning Skills 

1.1.2.03 Creativity Skills 

1.1.2.04 Communication Skills 

1.1.2.05 Motor Skills 

1.1.3.00 Knowledge and Skills Attitudes, Values, and Beliefs 
1.1.3.01 Intellectual Disposition 

1.2.0 Social Development 

1.2.1.00 Social Skills ' 

1.2.1.01 Interpersonal Participation 

1.2.1.02 Leadership 

1.2.1.03 Citizenship 

1.2.2.00 Social Attitudes, Values and Beliefs 

1.2.2.01 Political 

1.2.2.02 Racial/Ethnic 

1.2.2.03 Personal Ehtics 
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1.2.2.04 Social Conscience 

1.2.2.05 Socioeconomic Aspirations 

1.2.2.06 Cultural Interest 



1.3.0 personal Development 
1.3.1.00 Student Health 

1.3.1.01 Physical Health 

1.3.1.02 Mental Health 

1.3.2.00 Student Personal Attitudes, Values, and Beliefs 

1.3.2.01 Religious and Spiritual 

1.3.2.02 Change/Stability 

1 .3. 2. 03 "Self -Concept 

1.410 Career Development 

1.4.1.00 Career Preparation 

1 . 4 . 1 . 00 Academi c Prepara ti on 
1.4.1.02 Vocational Preparation 

1.4.2.00 Career Attitudes, Values, and Beliefs 

1.4.2.01 Achievement Orientation 

1.4.2.02 Educational Aspirations 

1.4.2.03 Educational Satisfaction 

1.4.2.04 Vocational Aspirations 

Development of New Knowledge and Art Forms 
2.0.0.01 Discovers^ of New Knowledge 
2.0.0.02 Interpretation and Application of New Knowledge 
2.0.0.03 Reorganization of New Knowledge 
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3.0 Community Development and Service 
3.1 .0 Community Development 

3.1.0.01 Community Educational Development 

3.1.0.02 Faculty/Staff Educational Development 
3.2.0 Community Service 

3.2.0.01 Extension Services 

3.2.0.02 Personal Services 

3.2.0.03 Extramural Cultural and Recreational Services 
3.2.0.04 Financial Impact on the Community 
3.3.0 Longer Term Community Effects 
3.3.0.01 Social Impact 
3.3.0.02 Economic Impact 
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OUTCOME VARIABLES 



POTENTIAL MEASURES 



1.0 Student Growth and Development 

1«K0 Knowledge and Skills Development 

1,1,1,00 Knowledge Developroent 

U1.1.01 General Knowledge 

The faiilllarUy with and understanding of 
facts and principles across several broad 
fields. The student's breadth of knowledge. 



Note: 



Many of the measures listed In 1.4.0 
Career Development may also apply in 1.1.0. 



1.1.1.01 General Knowledge Measures 

• Average student score on those Items from 
tests (e.g.. CLEP - General Exam; SAT Area 
Exam) that measure breadth of knowledge.* 

• Average student change In breadth of knowledge 
as determined by comparing entering general 
knowledge test scores to subsequent 

test scores (e.g.t on CLEPt the GRE. 
or SAT Area Exams) after years. 

- Average student-reported score on a scale 
measuring degree of satisfaction with breadth 
of knowledge (based on a student survey). 



^Standardized measures are referenced, at the end of this 


Inventory. 


OUTCOME VARIABLES 


.POTENTIAL MEASURES 



1.1.1.02 Specialized Knowledge 

The familiarity with and understanding of 
facts and principles in the particular fields 
In which the student elects to study. The 
student's depth of knowledge. 



1.1.1.02 Specialized Knowledge Measures 

- Average student score on those items from tests 
(e.g.. CLEP Subject Exams, or GRE Area Exams) that 
measure depth of knowledge in special fields of 
study. — 

« Average student change in depth af knowledge by 
discipline area as determined by comparing entering 
specialized knowledge test scores to subsequent 
test scores (e.g., on CLEP Subject Exams or 
GRE Area Exams) after years. 

• dumber of graduates accepting employment in their 
major field of study as a percentage of total 
graduates in that field. 

• Number of students passing certification or 
licensing exams (e.g.. bar exam. CPA) on first 
attempt as a percentage of all students taking 
the exam. 

• Average student- reported score on scale measuring the 
degree of satisfaction with their knowledge gain in 
specialized fields of study (based on a student 
survey). 

• Number of graduates accepted for study in post- 
baccalaureate degree programs as a percentage of 
those applying. 
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OUTCOME VARIABLES 


POTENTIAL MEASURES 


1.1.2.00 Skill OeveloDinent 

1.1.2.01 ApDilcatlon of Knowledge Skills 

Tht ability to relate relevant general or 
specialized knoMledge to a problem and to 
1«p1eflcnt a solution. Also, the ability to 
locatt, rtUln. and filter relevant knowledge. 

1.1.2.02 Critical Thlnkln? and Reasoning Skills 


1.1.2.01 Application of Knowledge Skills Measures 

- Average student score on those items from tests 
(e.g., CLEP Subject Exams, GRE or SAT Area Exams, 
or th«! OPI -Thinking Introversion Scale) that 
measure ability to apply general or specialized 
kno\f ledge. 

• Average student change. in ability to apply 
knowledge as determined by comparing entering 
ability test scores to subsequent test 

scores (e.g., on CLEP Subject Exams, the GRE or 
SAT Area Exams) after years. 

• Average student and/or former student*reported 
score on a scale measuring degree of satisfaction 
with their ability to apply what they know both 
Tn breadth and depth (based on a student and/or 
former student survey). 

1.1.2.02 Critical Thinking and Reasoning Skills 


Tht ability to formulate and analyze problems 
and to eflipioy rational processes tor achieve ' 
Increased understanding (e.g., the recognition 
of biased points of view In a speech or a book; 
the recognition of cause-and-effect relation* 
ships). 


Measures 

- Average student score on tests (e.g., OPI-Theoretlcal 
Scale; KIT-Critical Thinking Index, Critical Thinking 
Orientation Scale, or Critical Thinking Benefits Scale; 
AVL-Theoretical Scale) that' measure ability to 
formulate and analyze problems. 

- Average student change in ability to fonnulate 
and analyze problems as determined by comparing 
entering critical thinking ability scores on 
tests (e.g., OPNTheoretical Scale; KIT-Critical 
Thinking Index, Critical Thinking Orientation Scale. * 
or Critical Thinking Benefits Scale; AVL-Theoretical 
Scale) to subsequent test scores after years. 



OUTCOME VARIABLES 



POTENTIAL MEASURES 



1.1.2.03 Creativity Skills 

Tbeatiillty to design^ produce, or otherwise 
bring Into existence original perspectives, 
explanations, and implementations (e.g., the 
production of unique communication; the 
development of an effective plan or solution 
to a problem; or the creation of works of art). 



- Average student-reported score on scale measuring 
degree of satisfaction with their ability to apply 
what they know both in breadth and depth (based on 
a student survey). 

- Percentage of courses taken that are classified 
as emphasizing critical thinking and reasoning. 

1.1.2.03 Creativity Skills Measures 

- Average student score on tests (e.g., OPI-Canplexity 
of Outlook Scale; KIT-Art Scale, Music Scale, 
Literature Scale, or Orama Scale; AVL-Aesthetic 
Scale) that measure the ability to create original 
perspectives, explanations, and implementations. 

- Average student change in ability to create original 
perspectives, explanations, and Implernentatlons as 
determined by comparing entering creative ability 
scores on tests (e.g., OPi-Complexity of Outlook 
Scale; Kit-Art Scale, Music Scale, Literature Scale, 
or Orama Scale; AVL -Aesthetic Scale) to subsequent 
test scores after years. 

- Average student-reported score on a.scale measuring 
degree of satisfaction with their ability to 
create original perspectives, explanations, and 
Implementations (based on a student survey). 
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OUTCOME VARIABLES 


POTEHTIAL MEASURES 


1.1.2.04 Conmunlcitf on Skills 

Tht ability or competence to reid. nrlte, speik, 
ind listen. The ability to convey Information, 
attitudes, emotions, etc.; and also the ability 
to receive and Interpret communications. These 
skills also encompass nonoral, nonwrltten 
expression and perception, 

1.1.2.05 Hotor Skills 

The ability or competence In tasks requiring 
physical dexterity and skill. 


- Percentage of courses taken that art classifitd 
as emphasiring creativity* 

• Number of patents awarded/copyrights obtained by 
former students within tht past years (based 
on a former student survey). 

1.1.2.04 Communication Skills Measures 

- Average student score on tests that measure tht 
ability to communicate. 

- Average student change in ability to communicate AS 
determined by comparing entering scores on tests 
of coninunicatlve ability to subsequent test scores 
after years. 

- Percentage of courses taken that are classified as ' 
emphasizing conrninication skills. 

* Number of students participating in debate, encounter 
groups, etc., as a percentage of all students. 

1.1.2.05 Motor Skills Measures 

- Average student score on tests that measure notor 
skills. 

- Average student change in motor skills as determined 
by comparing entering skill test scores to subsequent 
test scores after years. 

- Number of students participating in Intramural and 
varsity athletics as a percentage of all students. 

- Percentage of courses taken that are classified as 
emphasizing motor skills. 




OUTCOME VARIABLES 


POTENTIAL MEASURES 


1.1.3.00 Knowledge and Skills Attitudes. 
Values, and Beliefs 

1.1.3.01 Intellectual Disposition 

The desire to continue self-initiated study 
and inqutry for its cm sake and/or for 
personal enjoyment. 

1.2.0 Social Development 

1.2.1.00 Social Skills 

1.2.1.01 Interpersonal Participation 

The ability to live and Interact with others. 
This variable may be further disaggregated 
into such categories as cooperation, friendly 
companionship, and organizational skills; 
the ability to handle stress. Isolation, 
and bias. 


1.1.3.01 Intellectual Disposition Measures 

* Average student change In perception and evaluation 
of their Interest In continued self-initiated study 
and Inquiry as determined by comparing entering 

. test scores on (e.g.. AVL-Intellectual Scale; KIT- 
Intellectual Orientation Scale) to subsequent test 
scores after years. 

* Percentage of students taking noncredit, independent 
stu4y, or special coursed. 

- Average student-reported score on a scale measuring 
their evaluation and perception of the amount of 
learning that took place outside of formal 
instruction (based on a student survey). 

- Number of books, records, tapes, and other library 
' materials checked out per student over a specified 

period of time. 

1.2.1.01 Interpersonal Participation Measures 

- Average number of memberships per student and/or 
former student In social, charitable, political, or 
civic organizations (based on a student and/or 
former student su^v^s). 
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OUTCOME VARIABLES 


POTENTIAL MEASURES 


1.2.1.02 Leadership 

The ibilfty to establish directions or 
courses of action and Influence others to 
follow. 


- Average number of awards and citations earned per 
student and/or former student for social contributions 
(based on a student and/or former student survey). 

• Student and/or former student perceptions and 
evaluations of their Interpersonal participation 
as deteimlned by selected measures (e.g., AVL* 
Soclal Scales CUES-Convnunlty Scale; F-Scale; 
KIT*Interpersona1 Index; Learning: Experiential 
Scale and Feeling About Other People Scale; 
ISS*Soc1al Subscale of Institutional Goals Section). 

- Average number of friends and acquaintances 
reported per student (based on a student survey). 

1.2.1.02 Leadership Measures 

• Average number of positions In local, state, and 
federal government held by students and/or former 
students (based on a student and/or former student 
survey)'. 

• Average number of offices In social, charitable, 
political, or civic organizations held by students 
and/or former students (based on a student and/or 
former student survey). 

- Students and/or former students participating In 
special social development programs; e.g., the 
Peace Corps and VISTA (based on a student and/or 
fonwr student survey) • 




OUTCOME VARIABLES 


POTENTIAL MEASURES 


1.2.1.03 Citizenship 

The ability to perfonn relative to the 
lights* duties, and privileges of a 
leinber of a coninun1ty« state, or nation. 


• Percentage of former students in management positions 
by the _th year following graduation (based on a 
former student survey). 

• Student and/or former student perceptions and evalu* 
ations of their leadership ability as determined by 
selected measures (e.g., AVL-Political ; F-Scale). 

1.2.1.03 Citizenship Measures 

- Percentage of students and/or former students who 
' voted in the last general election (based on a 

student and/or former student survey). 

• Average amount of monetary contributions per 
individual made to political, religious, and social 
organizations or special Interest groups over past 
year relative to income category (based on a student 
and/or former student survey). 

• Student and/or former student perceptions and evalu- 
ations of their performance as citizens as determined 
by selected measures (e.g., KIT^-Convnunlty Affairs 
Scale, National and State Politics Scale, and 
International and Intercultural Affairs Scale). 

- Average number of hours per month devoted to 
political, religious, and social organizations or 
special Interest groups over the past year per 
student (based on a student and/or former student 
survey). 



OUTCOHE VARIABLES 


POTENTIAL MEASURES 


1.2.2.00 Social Attitudes. Values, and Beliefs 

1.2.2.01 Political 

AttUudts toward systtmi of govenmnt. 
Including tho proctsses. Institutions, 
convtntlonst and tht Itvtl of political 
piitlclpAtldn. 

1.2.2.02 Racial/Ethnic 

Attltudts toward races or national 
orfglns other than one's own. 


1.2.2.01 Political Attitude Measures 

- Percentage of students and/or former students belong- 
ing to or holding office in political organizations 
(based on a student and/or former student survey). 

- Student and/or former student perceptions and evalua- 
tions of their political attitudes and beliefs as 
dttermined by selected measures (e.g., AVL«Po1itica1 
Scale; F-Scale; KIT-National and State Politics 
Scale, Community Affairs Scale, National Status and 
World Security Scale, Freedom of Expression Scale, 
Societal Viewpoints Scale). 

- Percentage of former students utilizing mechanisms of 
the political pro^cess; e.g., petitions circulated, 
hearings attended, letters written, lobbying 
activities (based on a former student survey). 

1.2.2.02. Racial/Ethnic Attitude Measures 

- Student and/or former student perceptions and 
evaluations of their racial and ethnic attitudes 
and beliefs as determined by selected measures 
(e.g., KIT<»M1nor1ty Problems Scale; E-Scale). 



OUTCOME VARIABLES 


POTENTIAL MEASURES • 


1.2.2.03 Personal Ethics 

Ethical and moral values that affect an ^ 
Individual's actions and thoughts toward 
others. The sense of what Is right or 
wrong In one's conduct and motives in 
dealings between Individuals and groups. 

1.2.2.04 Social Conscience 

The concern for human welfare. The importance 
placed on hunan Interests, values, and 
conditions. 


* Number of students and/or fprmer students who 
are partners in an interracial marriage as a 
percentage of survey sample (based on student 
and/or former student surveys). 

- Percentage of elected student offices held by 
members of ethnic minorities. 

1.2.2.03 Personal Ethics Measures 

- Student and/or former student perceptions and 
evaluations about their ethical and moral values 
as determined by selected measures (e.g., AVL- 
Religious Scale and Social Scale; KIT-Feelings 
About Other People Scale). 

« Percentage of former students arrested on felony 
and misdemeanor charges during the last 
years (based on former student survey). 

1.2.2.04 Social Conscience Measures 

Note: Many of the measures suggested in 1.2.1.01 
Interpersonal Participation and 1.2.1.03 
Citizenship also apply here. 

- Student and/or former student perceptions and evalu- 
ations about their concern for human welfare as 
determined by selected measures (e.g., AVL -Social 
Scale; KIT«Societal Viewpoints Scale, Human Relations 
Scale. Societal Priorities Scale; OPI-Social Maturity 
Scale). 
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Outcome variables 


POTENTIAL MEASURES 


1.2.2.0S Socloeeonofflle Aspirations 

Tht Importancf attached to ont's socloeconoiilc 
status • 

Cultural Interest 


1.2.2.0S Socioeconomic Aspirations Measures 

- Average student and/or former student-reported score 
on scales measuring perceptions and evaluations of 
their current and desired social and economic level 
(based on a student and/or former student survey). 

1.2.2.Qfi Cultural Interest Measures 


Th« Interest In and acquaintance with arts* 
Banners^ scholarly pursuits, and other 
qualities that characterize civilizations. 


» Student and/or fonner student perceptions and evalu* 
atlons of their Interest In culture as determined by 
selected iwasures (e.g.. KIT-Educatlonal Benefits: 
Humanistic Scale). 

• Percentage of courses (credit and/or noncredit) 
_ takea that are classified as emphasi zing cultural 
Interests. 



OUTCOME VARIABLES 


POTENTIAL MEASURES 


1.3.0 Personal Development 
1.3.1.00 Student Health 

1.3.1.01 Physical Health 

The physical well-being of students and/or former 
students. 

1.3.1.02 Mental Health 

The mental well-being of students and/or fowier 
students. 

1-3 ? nn student Personal Attitudes. Values, 
and Beliefs 

1.3.2-01 Rellqlous and Spiritual 

Attitudes toward and adherence to the 
conventions, practices, and teachings* of 
religious organizations or sects* 


1.3.1.01 Physical Health Measures 

- Percentage of students and/or former students report- 
ing physical Illnesses, by type of Illness (based on 
a student and/or former student survey). 

1.3.1.02 Mental Health Measures 

» Percentage of students and/or fonner students report- 
ing rantal Illnesses, by type of Illness (student 
and/or fonner student survey). 

« Percentage of students participating In special 
mental health counseling programs. 

1.3.2.01 ftellalous and Solrttual Attitude Measures 

• PercenUge of students and/or fonner students belong- 
ing to or holding office In religious organizations 
(based on a student and/or former student survey). 

- Student and/or fbnner student perceptions and evalu- 
ations of their religious and splHtual attitudes and 
beliefs as dctemlned by selected measures (e.g.. 
AVL -Religious Scale; KIT-Religlon Scale and General 
Values 1 Ideologies Scale; OPl-Rellglous liberalism 
Scale; T-CR). 

- Percentage of students regularly attending religious 
services. 
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OUTCOHE VARIABLES 


POTENTIAL MEASURES 


1.3.2.02 Changt/StabllUy 

Attitudes towtrd new end different Ideas. 
riUtlonshlpSt products, or methods. The 
desire to Introduce, tvold, or be tssocltted 
irttli changes. 

1.3.2.03 Se1f*ConceDt 

The feeling and acceptance of oneself 
11 having basic wrth and value. 


• Average monetary contribution per former student to 
religious organizations relative to Income category 
(based on a former student survey). 

1.3.2.02 Chanqe/Stablllty Attitude Measures 

• Student and/or former student perceptions and 
evaluations about their attitudes and beliefs 
toward new and different things as determined 

by selected measures (e.g., KIT-Areas and Agents 
of Change Scale, Involvement In Campus Refonns 
Scale; Rokeach Dogmatism Scale). 

• Average ^number of changes In employment per 
foimer student during the past years 
(based on a former student survey). 

1.3.2.03 Self-Conceot Measures 

• Student and/or former student perceptions about 
oneself as determined by selected measures (e.g., 
KXT-Fee11ngs About Self Scale). 



OUTCOME VARIABLES 


POTENTIAL MEASURES 


1.4.0 Career Development 

1.4.1.00 Career Preparation 

1 •4.1.01 Academic Preparation 

The ability to seek, gain, and maintain a 
particular level and kind of academic pursuit. 


1.4.1.01 Academic Preoaratlon Measures 

• Average number of awards and citations received 
per graduate for academic performance (based on 
a former student survey). 

• Percentage of graduates working toward or receiving 
an advanced degree or certificate years 

after graduation (based on a former student survey). 

• Percentage of graduates enrolled In graduate school 

years after graduation (based on a former 
student survey). 

• Average student and/or former student-reported score 
on a scale measuring the degree of satisfaction 
with their academic performance (based on a student 
and/or former student survey). 

• Number of dropouts during the past year as a 
percentage of their academic rank or the total 
Institution enrollment. 

• Number of students graduating from the institution 

yg*!^ M * percentage of the entering 

Class. 

• Number of graduates who transferred in as a 
percentage of total graduates for the year. 
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OUTCOME VAKIA8LCS 


POTENTIAL MEASURES 


l.4.l'.02 Vocational Preparation 

Iht ablllt;/ to stek» gain* and maintain a 
particular Uvtl and kind of eiplaymnt. 


• Percentage of students changing major (lower division* 
upper division* and/or graduate) during the past 
year. 

1.4.1.02 Vocational Preparation Measures 

• Percentage of former students employed within 

days after graduation (based on a former student 
survey). 

- Average first salary of former students (based on a 
former student survey). 

• Average l^lcome category for former students after 

years (based on a former student survey). 

- Percentage of dropouts employed within _ days 
after dropping out (based on a survey of dropouts). 

• Average score of dropouts on a scale measuring 
the degree of satisfaction with their vocational 
performance (based on a survey of dropouts). 

• Average number of professional awards and citations 
received by fonner students (based on a former 
student survey). 

- Percentage of former students In management positions 
by the th year following graduation (based on a 
fonner student survey). 




OUTGONE VARIABLES 


POTENTIAL MEASURES 


1.4.2.00 Career Att1tude$. Values, and Beliefs 

1.4.2.01 Achievement OrlenUtlon 

The Importance placed upon accomplishments; 
1.e.» successfully completing work that is 
valued by the individual and/or society. Impact 
or benefit as viewed by the student and/or 
the larger society. 


- Average score reported by fonner students on a scale 
measuring satisfaction with their vocational 
performance (based on a former student survey). 

• Number of former students who desire to have 
their children follow the same career field as 
a percentage of the total number of former 
students surveyed (based on a former student 
survey). 

• Average number of voluntary /In voluntary changes In 
employment over given time periods per fonner 
student (based on a fonner student survey). 

- Percentage of total graduates employed 1n«state 
versus out-of-state. 

• Average number of voluntary/Involuntary changes In 
career field over given time periods per fonner 
student (based on a fonner student survey). 

1.4.2.01 Achievement Orientation Measures 

- Student and/or graduate perceptions and 
evaluations of achievement as determined by 
selected measures (e.g.* KIT-Feellngs About 
the Future Scale). 
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OUTCOME VAKIABLES 


POTENTIAL MEASURES 


1.4.2.02 Educational Aspirations 

Tht tducatlonal degret and/or competency 
Itvtl desired and valued by students and/or 
graduates. 

l.A.2.oa Educational Satisfaction 

The degrtt of student satisfaction with 
thtir tducatlonal cxperitnct. 

1.a.2.oa Vocational Asolratlons 

The Itvtl of attainment In a profession 
desired by students and/or graduates* 


1.4.2.02 Educational Aspirations Measures 

• Percentage of students identifying the 

degree (none, associate, bachelor's, rpastier*s» 
doctoral, other) as the highest degree planned 
(based on a student survey). 

• Percentage of graduates working toward or 

receiving an advanced degree years after 

graduation (based on a former student survey). 

1.4.2.03 Educational Satisfaction Measures 

• Percentage of former students who intend to send 
their children to the same school (based on a 
fonner student survey). 

- Average amount of alumni gifts years after 
their graduation. 

- Average student and/or former student-reported 
score on a scale measuring the degree of satisfaction 
with their educationaUexperience (based on a 
student and/or fonner student survey). 

1.4.2.04 Vocational Aspirations Measures 

-* Average first salary expectations of students 
(based on a student survey). 




OUTCOME VARIABLES 


POTENTIAL MEASURES 


2.0 Development of New Knowledge and Art Forms* 

2.0 .0.01 Olscovery of New Knowledge 

The Identification and development of new 
knowledQe. theories* and products without 
regard to practical application^ 


• Percentage of students and/or former students 
seeking certain professional levels in society 
(based on a student and/or former student survey)* 

2.0.0.01 Discovery of New Knowledge Measures 

- Average number of basic research publications 
per studentt former student, and/or faculty member 
over a given time period (based on a student, 
fonner student, and/or faculty survey). 

-* Average number of times a given basic research 
publication is cited In bibliographies of other 
authors over a given time period (e.g., based on 
publications listed in Science Citation Index). 
(Note: both frequency and the time interval 
over which citations are made should be considered.) 

• Average percentage of faculty time spent in 
selected basic research activities (e.g., NCHEMS 
Faculty Activity and Outcome Survey - Section B.I 
Specific Research Projects). 

•> Average number of proposals funded for the development 
of new ideas and products during year(s)* 

• Total dollar amount of gifts and/pr grants 
received for the development of new Ideas and 
products without concern for practicality as a 
percentage of total budget for year(s). 



«Tht current Inventory does not contain variables and measures related to the development of New Art Forms. 
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OUTCOME yARIABUS 


POTENTIAL MEASURES 


2.0.0.02 Interpretation and Apollcatlon of 
Ntw KnoMiedgt 

Hit tftvtloPMnt and ust of new knowltdge, 
thfoiies. and products with regard to practlcel 
ipplfcatlon. 


2.0.0.02 Interpretation and Application of New 
knoMledge Measures 

« Average number of applied research, development, 
and evaluation publications per student, graduate, 
and/or faculty member (based on a student, fonner 
student, and/or faculty survey). 

• Average percentage of time spent by faculty In 
selected applied research. develofKnent. and 
evaluation activities (based on NCHEMS Faculty 
Activity and Outcome Survey - B.I Special Research 
Projects. E.2 Prorfesslonal Service and Advice, and 
F.I Academic Activity Outside the Institution). 

• Average number of awards and citations received 
per student, former student, and/or faculty member 
for applied research, development, and evaluation 
efforts (based oh a student, fonner student, and/or 
faculty survey). 

• Average number of applied research, development, and 
evaluation proposals funded during past year(s). 

• Total dollar amount of gifts, contracts, or grants 
received for applied research, development, and — 
evaluation as a percentage of total budget for 
yeer(s). 




OUTCOME VARIABLES 


POTENTIAL MEASURES 


2.0.0.03 Reorganization of New Knowledqe 

The synthesis of existing theories, findings, and 
statements In order to present existing knowledge 
In a new form designed to be more readily ^ 
coiRprehenslble or usable (e.g., new textbooks, 
written articles, and oral communications). 


- Average number of patents and/or copyrights re- 
ceived per student, fonner student, and/or faculty 
member over a given time period (based on a student, 
fbimer student, and/or faculty survey). 

2.0.0.03 Reorganization of New Knowledge Measures 

- Average number of textbooks, monographs, etc., 
published per faculty member (based on a faculty 
survey). 

- Average percentage of faculty time spent In 
reorganizing existing knowledge (based on NCHEMS 
Faculty Activity and Outcome Survey • Section A. 4 
Course and Curriculum Development). 

- Average number of films, taped lectures, etc., 
developed per faculty member (based on a faculty 
survey). 
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OUTCOHE VARIABLES 


POTENTIAL MEASURES 


3.0 Cenmunlty Development and Service 

3* 1*0 Community Development 

3*1.0.01 Comminlty Educitlonal Development 

The groMth end development of members of the 
comnlty who are not working toward a degree 
or certification, but who are taking advanUge 
of continuing education opportunities 
offered. 

3.1.0.02 Faculty/SUff Educational Development 


3.1.0.01 Connunlty Educational Development 
Measures 

- Note: Measures listed in 1.1.1.01 General Knowledge^ 
1.1.1.02 Specialized Knowledge, 1.1.2.01 Application 
of Knowledge, 1.1.2.02 Critical Thinking and Reasoning 
Skills* and 1.1.2.03 Creativity can also be utilized as 
Indicators of Community Educational Development* 

• Percentage of students In various Instructional 
programs who are classified as nonmatrlculatlng. 

3.1.0.02 Faculty/Staff Educational Development 


the growth and development of faculty and * 
suff either through their Instruction, 
research, or management activities or through 
the continuing education opportunities offered. 


Measures 

• Percentage of faculty/staff who are taking 
courses In the Institution. 

• Percerftage of faculty time spent In selected 
activities (based on NCHEMS Faculty Activity 
and Outcome Survey • B.2 General Scholarship 
and Creative work, F.l Academic Activity Outside 
the Institution). 

• Faculty and staff perceptions and evaluations of 
their educational growth and development (based 
on a faculty/staff survey). 




OUTCOME VARIABLES 


POTENTIAL MEASURES 


3.2.0 Connunlty Service 

3.2.0.01 Extension Services 

the extent to which the community receives 
direct assistance and services of various 
types from the primary programs of the 
Institution (e.g., agriculture extension 
service* other nonlnstructlonal extension 
activities* faculty/suff consulting). 


3.2.0.01 Extension Services Measures 

• Average percentage of faculty time spent In 
selected activities (based on NCHEMS Faculty 
Activity and Outcome Survey «• E.2 Professional 
Service and Advice, F.I Academic Activity Outside 
the Institution, F.2 Paid Professional Service). 

• Estimated replacement value of specific extension 
services received by Individuals or organizations 
that receive the services. 

• Ratio of total Income for extension services to 
total budget for extension services. 

« Income produced through extension services, as 
a percentage of the cost of offering the servlce(s). 

• Amount of release time granted faculty members 
per year for community service. 
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OUTCONE VARIABLES 


POTENTIAL MEASURES 


3.2.0,02 Personal Services 

Iht extent to Mhlch Individuals In the connunlty 
receive direct personal services of various 
types through the support programs and facilities 
of the Institution fe.g.. medical clinics that 
serve the general community, nursery schools, 
Mcess to the Hbraiy, and computer center), 

3.2.0.03 Extramural Cultural and Recreational 
services 


3.2;0.02 Personal Services Measures 

- Number of individuals not associated with the institu- 
tion who were served by a particular institutional 
support program (e.g., the computing center, the 
I^Sr*!?* V^'^ percentage of the total nunter of 
individuals served over a given time period, 

• Estimated monetary value of specific personal 
services offered relative to other comparable 
services offered elsewhere. 

3.2.0.03 Extramural Cultural and Recreational 


Ihe availability and utilization of the recre- 
ational and cultural opportunities offered through 
the Institution to the community (e.g.» sporting 
•vents, the performing arts, museum exhibiu, 
and concerts). 


»rvices Measures 

« Estimated number of nonstudents, nonfacultyt and 
nonstaff attending selected extrxnural events as 
a percentage of the total number attending. 



OUTCOME VARIABLES 



3.2.0.04 Financial Impact on the Community 

the economic benefits or costs directly and 
Indirectly accruing to the community as a result 
of the operation of the institution, including such 
elements as: 1) purchases of goods and services 
by the institution, its students, and its faculty; 
2) students available as employees; 3) drawing 
poMer of the conmunlty for industry «nd as a place 
of residence for employees. 



POTENTIAL MEASURES 



3.2.0.04 Financial Impact on the Coimnunitv Measures 

•* Total dollar amount of goods and services purchased 
by the institution from a particular sector of 
the community during the past year. 

« Estimated average dollar amount of expenditures 
by students in the community. 

« Number of students employed in businesses, 
agencies, and organizations in the comniunity 
as a percentage of the total student enrollment 
(based on student survey). 

- Total dollar amount of the Institution's payroll 
as a percentage of the estimated total community 
PKyroll. 
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OUTCOME VARIABUS 


POTe^iTlAL MEASURES « 


3.3.0 LonQcr Term Connunlty Effects 
3.3.0.01 Social Imoact 

Tht 1ong«tenn social effects of the Institution, 
priMrlly through Its former students, on the 
coHwnl^ of tht Institution. 

3.3.0.02 Economic Impact 

The long-term economic effect of the Institution, 
primarily through Its former students, on the 
communis* 


3.3.0.01 Social Impact Measures 

Note: Many of the measures listed In Section 
1.2.0 Social Development and 1.3.0 Personal 
Development can be applied equally well over long 
time periods and also to children of former students 
If attempts are made to Identify Intergeneratlonal 
effects. 

3.3.0.02 Economic Impact Measures 

Note: Many ineasures listed In Sections 1.2.2.05 
Socioeconomlr Aspirations, 1.4.1.02 Vocational 
Preparation, 1.4.2.04 Vocational Aspirations, and 
the research*or1ented outcome Indicators In Section 
' 2.0 Development of New Knowledge and Art Forms can 
bt applied equally well over long time periods. 
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APPENDIX B 



LISTS OF OCCUPATIONS 
AND EDUCATIONAL PROGRAMS'^ 



♦Two lists of occupations and educational programs (major field of study) 
are contained in this appendix. List B.l has been developed by NCHMES 
for use in the Information /Exchange Procedures Outcomes Study Procedures, 
Technical Report 66 (Byers,f 1975). List B.2 has been developed and used 
by the American College Testing Program in the 1974-75 edition of the "ACT 
Interest Inventory and Student Profile Section." It is presented here 
with the permission of the ACT Program. 
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LIST 8.1 

LIST OF OCCUPATIOfiS AND EDUCATIONAL ^ROnUHS 

If tht approprUtt prboram-or occupation is not listed, Pleasf use the 999 code and 
«rlti the progran or occupation name In the spact provided on the questionnaire. 



030 AGKICULTUKE AND NATURAL RESOURCES 

031 Agriculture, general 

032 Natural resources, general 

833 Agricultural business and economics 
34 Agricultural and farm runagetrent 
03S Agronomy and horticulture 
031 Anlnal. dairy, and poultry science 
037 Fish, game, andnlldllfe nunagement 
030 Food science and technology 
039 Forestry, natural resource, and 

range managenent 
041 Ornamental horticulture (florlstry and 
nursery science) 

OfO ARCHITECTURE ANO ENVIROrmEKTAL DESIGN 
Ofil Architecture, general 
0S2 environmental design, general 
OiS Architectural technology 
0€4 Clty» connunlty, and regional planning 

090 ASSEHILY, INSTALLATION, MAlHTEfWiCE, AND RERAIR 

091 Air conditioning, refrigeration, and 

heating equipment 

092 Aircraft and related equipment 

093 Appliances 

094 Automotive equipment 

095 luslness machines (Including computers and 

related equipment) 
09f Diesel equipment . ^% 

097 Electronics equipment (except radio and TV) 
090 Heavy machinery and equipment 
099 Radio and TV equipment 

120 IIOLOCICAL SCIENCES 

121 Biology, general 

122 lotany 

123 Ecology 

124 Genetics 

125 Zoology 

ISO lUILOING AND CONSTRUCTION TRADES 

110 WSINESS, KANAGET^HT, AKD COt^^ERCE 

111 luslness and comerce, general 

112 Accounting ^ , ^ ^ 

113 luslness management and administration 
164 Hotel and restaurant rrananement 

IIS Labo^ and Industrial relations 

US Marketing and Purchasing 

117 Office ranageflicnt and operations 

IM Personnel management 

119 Recreation and tourism 

191 Sales 

192 Secretarial studies 

193 Transportation and public utflUles 

nanageoent 

210 COfSWlICATIONS 



211 
212 



213 
214 



CoflnunlcatlonSf general 
Advertising, Infonnatlon services, 

and public relations 
Journalism (printed media) 
Radio and television 



240 



COWUTER AND INFORMATION SCIENCES 

241 Computer and Information sciences, general 

242 Computer and peripheral equipment operations 

243 computer progrannlng 

244 Oau processing 

245 Information sciences and systems 
241 Systems analysis 

270 EDUCATIOH 

271 Education, general 

272 Counseling and guidance 

273 Educational adnlnlstratlon 

274 Educational research and development 

(Including curriculum) ^ 

275 Elementary education (Including preschool) 
271 Secondary education (Includinq junior high) 
277 Higher and other postsecondary education 
271 Special education 

300 ENGINEERING 

301 Engineering, general 

302 Aerospace, aeronautical, and astronautleal 

engineering * 

303 Automotive engineering 

304 Chemical engineering 

305 Civil, construction, and transportation 

engineering « 
30C Drafting and design 

307 Electrical, electronics, and communications 

engineering 
300 Engineering support technologies 
309 Environmental and sanitary engineering 
311 Industrial and mana<)(>ment engineering 
^12 Mechanical engineering 

313 Mining and mineral engineering 

314 Petroleum engineering (excludes petroleun 

refining) 

330 FINEt APPLIED, AND PERFnR^!ING ARTS 

331 Art and applied design (e.g., ceramics, 

painting, sculpture, weaving 

332 Art history 

333 Graphic arts (e.g., engraving, etching, 

lithography) 

33S Performin>) arts (e.g., dance, drama, music) 
33€ Photography and cinenatography 



3CD FOREIGN LANGUAGES 

390 HEALTH SERVICES 

391 Health seivlces, general 

392 Dental or medical assistant services 

393 Dental or medical laboratory technologies 

394 OenUl hygiene 

395 Dentistry 

391 Electrocardiograph and electro- 
encephalograph technologies 

397 Hospital and health care administration 

391 Inhalation therapr\y 

399 Medical records 

401 Medicine 

402 Mortuary science 

403 Nursing 

404 Optometry 

405 Osteopathic medicine 
40C Phamacy 

407 Physical and occupational therapy 

406 Podiatry 

409 Public health and sanitation 

411 Radiologic technologies (e.g.. X-ray) 

412 Speech pathology 

413 Veterinary medicine 

420 HOME ECONOMICS AND HOHEHAKING 

421 Home economics and homenaking, general 

422 Clothing and textiles 

423 Consumer economics and home manaqcnent 

424 Family relations and child dcvelopr<ent 

425 Foods and nutrition (Including dietetics) 
421 Home decoration and home equipment 

450 IKTEROISCIPLINAKV STUDIES 

410 LAV 

510 LEHERS 

511 Classics 

512 Cofcparatlve literature 

513 Creative writing 

514 English, general 

* 51$ English literature 
5U Linguistics (Includes phonetics, scirantlcs 
and philology) 

517 Philosophy , , , 

518 Religious studies (excludes theological 

professions) 

540 LIIRARY SCIENCE 

570 MACHINE TRADES 

iOO MATHEMATICS AND STATISTICS 

S3D MILITARY SCIENCES 

StO PERSONAL SERVICES . ^ 

Ml Qarbering, cosmetology* and related 

services 
162 Food and beverage services 
613 Hotel and lodging services 
664 Other personal services 

690 PHYSICAL SCIENCES 

691 Physical sciences, general 

692 Astronomy and astrophysics 

693 Atmospheric sciences and meteorology 

694 Chemistry, general 

695 Earth sciences, general 

696 Geology 

697 MeUUurgy 
691 Oceanography 
699 Physics, general 

720 PSYCHOLOGY 

721 Psychology, general 

722 Clinical psychology 

723 Experimental psychology 
' 724 Psyc home tries 

7S0 PUBLIC AFFAIRS AND SERVICES 

751 Community services, general 

752 Fire protection 

753 Law enforcement and corrections 

754 Parks and recreation 

755 Public administration 

756 Social t«rk and helping services 

780 SOCIAL SERVICES 

781 Social sciences, general 

762 Anthropology 

783 Archaeology 

784 Area studies 

785 Economics i*^'' 
766 Ethnic studies 

717 Geography and demography 

788 History 

789 Internetlonal relations 

791 Political science and government 

792 Sociology 

110 THEOLOGY 
991 UNDECIDED 

999 OTHER (please write the nare of the 

educational program or occupation In the 
space provided on the questionnaire) 
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LIST B«2 

LIST OF OCCUPATIONS AND EDUCATIONAL PROGRAMS 



100 
101 
102 
103 

104 

106 
107 
108 
109 
110 
111 



AGRICULTURE, general ^ 
Agricultural Business 
Agricultural Economics 
Agricultural and Farm Management 

(farming and ranching) 
Agriculture, Forestry, and Wildlife 

Technologies 
Agronoiny field crops and crop management) 
Animal Science (hiiisbandry) 
Fi slj^lGame; and Wi Idlif^e Management 
Food Science and Technology 
Forestry 

Horti cu 1 ture/Ornamental Horti cul ture 
Natural Resources Managemenit 
(soil conservation) 



120 ARCHITECTURE, general 

121 Architecture Technology 

122 City, Conmunity, and Regional Planning 

123 Environmental Design, general 

124 Interior Design 



130 BIOLOGICAL SCIENCES, general 

131 Biology 

132 Biochemistry 

133 Botany 

134 Ecology 

135 Microbiology 

136 Zoology 



140 BUSINESS AND COMMERCE, general 

141 Accounting 

142 Banking and Finance 

143 Business Economics 

144 Business Management and Administration 

145 Food Marketing 

146 Hotel and Restaurant Management 

147 Labor and Industrial Relations 

148 Office Management 

149 Marketing and Purchasing 

(sales and retail) 

150 Real Estate and Insurance 

151 Recreation and Tourism 

152 Secretarial Studies 

153 Transportation and Public Utilities 



160 COMMUNICATIONS, general 

161 Journalism 

162 Radio/Television (related to broadcasting) 

163 Advertising 



170 COMPUTER AND INFORMATION SCIENCES, general 

171 Computer Programming 

172 Information Systems and Sciences 

173 Systems Analysis 

174 Data Processing Technology 

175 Computer Operating 

176 Data Systems Repair 



180 EDUCATION, general 

1B1 Agricultural Education 

182 Art Education 

183 Business, Commerce, and Distributive 

Education 

184 Elementary Education 

185 English Education 

186 Home Economics Education 

187 Industrial Arts, Vocational /Technical 

Education 

188 Mathematics Education 

189 Music Education 

190 Physical Education 

191 Science Education 

192 Secondary Education, gener^al 

193 Social Science Education 

194 Special Education 

195 Speech Education 



200 
201 
202 
203 
204 
205 
206 

207 
208 
209 
210 
211 
212 
213 
214 
215 



ENGINEERING, general 

Aerospace, Aeronautical, and Astronautical 
Agricultural Engineering 
Architectural Engineering 
Chemical Engineering^ 
Civil Engineering 

Electrical, Electroncis, and Communications 

Engineering 
Environmental and Ecological Engineering 
Geological Engineering 
Industrial and/or Management Engineering 
Mechanical Engineering 
Metallurgical and Materials Engineering 
Mining and Mineral Engineering 
Nuclear Engineering 
Ocean Engineering 
Petroleum Engineering 



220 FINE AND APPLIED ARTS, general 

221 Applied Design (ceramics, weaving, 

conmercial art) 

222 Art (painting, drawing, sculpture) 

223 Art History and Appreciation 

224 Dance 

225 Dramatic Arts (theater arts) 

226 Music (liberal arts) 

227 Music (performing, comoosition, theory) 

228 Music History and Aporeclation 

229 Photography/Cinematography 



230 FOREIGN LANGUAGES, general 

231 French 

232 German 

233 Italian 

234 Latin 

235 Spanish 

236 Russian 
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LIST 8.2 (continued) 



240 HEALTH PROFESSIONS » general 

241 Dentistry 

242 Dental Assistant 

243 Dental Hygiene 

244 Dental Lab Technology 

245 Environmental Health Technologies 

246 Medicine 

247 Medical Assistant or Medical Office 

Assistant 

248 Medical or Laboratory Technology 

249 Nursing (registered) 

250 Nursing (licensed practical nurse) 

251 Occupational Therapy 

252 Optometry 

253 Pharmacy 

254 Physical Therapy 

255 Public Health 

256 Radiology 

257 X-ray Technology 

258 Surgical Technology (surgeon's 

assistant* etc.) 

259 Veterinary Medicine 



260 HOME ECONOMICS* general 

261 Clothing and Textiles 

262 Consumer Economics and Home Management 

263 Family Relations and Child Development 

264 Foods and Nutrition (including dietetics) 

265 Institutional Management 



270 LETTERS (Humanities), general 

271 Classics 

272 Comparative Literature 

273 Creative Writing 

274 English, general 

275 Linguistics 

276 Literature. English 

277 Philosophy 

278 Religion 

279 Speech. Debate. Forensic Science 



280 MATHEMATICS, general 

281 Applied Mathematics 

282 Statistics (mathematical and theoretical) 



285 PHYSICAL SCIENCE, general 

286 Astrononiy 

287 Chemistry 

288 Earth Sciences 

289 Geology 

290 Oceanography 

291 Physics 



310 SOCIAL SCIENCES, general 

311 Anthropology 

312 Area Studies (American Civillzition, 

American Studies, etc.) 

313 Economics 

314 Ethnic Studies (Asian Studies, Black 

Studies. Chicano Studies, etc.) 

315 Geography 

316 History 

317 International Relations 

318 Law (prelaw) 

319 Political Science 

320 Psychology 

321 Sociology 



330 TRADE, INDUSTRIAL, AND TECHNICAL, general 

.331 Agricultural Mechanics and Technology 

332 Air-Conditioning'. Refrigeration, and 

Heating Technology 

333 Aeronautical and Aviation Technology 

334 Appliance Repair 

335 Automobile Body Repair 

336 Automobile Mechanics 

337 Business Machine Maintenance 

338 Carpentry and Construction 

339 Drafting/Engineering Graphics 

340 Electricity and Electronics 

341 Engineering Technology— Aeronautical 

342 Engineering Technology— Automotive 

343 Engineering Technology—Civil 

344 Engineering Technology— Industrial/ 

Manufacturing 

345 Engineering Technology— Mechanical 

346 Qw^lc Arts (printing, typesetting) 

347 Heavy-Equipment Operating 

348 Dry Cleaning, Laundry, and Clothing 

Technology 

349 Industrial Arts 

350 Leatherworking (shoe repair, etc.) 

351 Machinework (tool and die. etc.) 

352 Masonry (brick, cement, stone, etc.) 

353 Metal working 

354 Plumbing and Pipefitting 

355 Radio-TV Repair 

356 Small -Engine Repair 

357 Upholstering 

358 Watch Repair and other Instrument 

Maintenance and Repair 

359 Welding 

360 Woodworking (cabinetmaking. millwork) 



370 GENERAL STUDIES 



000 Undecided 



300 COMTIUNITY SERVICE, general 

301 Law Enforcement and Correction 

(police science) 

302 Parks and Recreation Management 

303 Public Administration 

304 Social Work 

305 Military 
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HIGHER EDUCATION GENERAL INFORMATION 
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APPENDIX C 
THE HEGIS TAXONOMY* 

In view of the length and comprehensive nature of the Taxonomy of Instructional 
Programs , it may sometimes be diffucult to 1( :ate the appropriate reporting 
title for a specific instructional program. Is, facilitate the location pro- 
cess, a summary list of the program categories (discipline categories) is 
shown below. 

PROGRAM (DISCIPLINE) CATEGORIES 



(Conventional academic subdivisions of knowledge and 
training) 

Code 

0000 GENERAL 

0100 AGRICULTURE and NATURAL RESOURCES 
0200 ARCHITECTURE and ENVIRONMENTAL 

DESIGN 
0300 AREA STUDIES 
040^ DIDLDGICAL SCIENCES 
0500 BUSINESS and MANAGEMENT 
0600 COMMUNICATIONS 
0700 COMPUTER and INFORMATION SCIENCES 
0800 EDUCATION 
0900 ENGINEERING 
1000 FINE and APPLIED ARTS 
1100 FOREIGN LANGUAGES 
1200 HEALTH PROFESSIONS 
1300 HOME ECONOMICS 
1400 LAW 
1500 LEHERS 
1600 LIBRARY SCIENCE 
1700 MATHI-MATICS 
1800 MILITARY SCIENCES 
1900 PHYSICAL SCIENCES 
2000 PSYCHOLOGY 
2100 PUBLIC AFFAIRS and SERVICES 
2200 SOCIAL SCIENCES 
2300 THEOLOGY 

4900 INTERDISCIPLINARY STUDIES 



(Technplogital and occupational specialties related to cuf* 
riculnms leading to associate degrees and other awmds 
below tite haccalanreate) 

Code 

5000 BUSINESS and COMMERCE TECHNOLOGIES 
5100 DATA PRCSESSING TECHNOLOGIES 
5200 HEALTH SERVICES and PARAMEDICAL 

TECHNOLOGIES 
5300 MECHANICAL and ENGINEERING 

TECHNOLOGIES 
5400 NATURAL SCIENCE TECHNOLOGIES 
1500 PUBLIC SERVICE RELATED TECHNOLOGIES 



♦Source: Robert A. Huff and Marjorie 0. Chandler, A Taxonomy of Instructional 
Programs in Higher Education (Washington, D.C.: National Center for Educa- 
tional Statistics, Office of Education, 1970). 
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PROGRAM (DISCIPLINE) SUBCATEGORIES 



A listing of all probram (discipline) Subcategories is given below by discipline 
categories. This section is included for purposes of definition to indicate 
which specific program subcategories are included in each program category. 



0000 GENERAL USE 

0100 AGRICULTURE AND NATURAL RESOURCES 

0101 Agriculture, General 

0102 Agronomy (Field Crops, and Crop 

Management) 

0103 Soils Science (Management and ConservatiOD) 

0104 Animal Science (Husbandry) 

0105 Dairy Science (Husbandry) 

0106 Poultry Science 

0107 Fish» Game, and Wildlife Management 

0108 Horticulture (Fruit and Vegetable 

Production) 

0109 Ornamental Horticulture (Floricultuiti 

Nursery Science) 

0110 Agricultural and Farm Management 

0111 Agricultural Econnmics 

0112 Agricultural Business 

0113 Food Science and Technology 

01 14 Forestry 

0115 Natural Resources Management 

0116 Agriculture and Forestry Technologies 

0117 Range Management 
0199 Other. Specify 

0200 ARCHITECTURE AND ENVIRONMENTAL DESIGN 

0201 Environmental Design, General 

0202 Architecture 
02f)3 Interior Design 

0204 Landscape Architecture 
02 )5 Urban Arcliitecture 
0206 City» Community, and Regional Planninf 
Other, Specify 

0300 AREA STUDIES 

0301 Asian Studies, General 

0302 East Asian Studies 

0303 South Asian (India, etc.) Studies 

0304 Southeast Asian Studies 

0305 African Studies 



0306 Islamic Studies 

0307 Russian and Slavic Studies 

0308 Latin American Studies 

0309 Middle Eastern Studies 

0310 European Studies, Generid 

0311 Eastern European Studies 

0312 West European Studies 

0313 American Studies 

0314 Pacific Area Studies 
0399 Other, Specify 

0400 DIOLOGICAL SCIENCES 

0401 Biology, General 

0402 Botany, General 

0403 Bacteriology 

0404 Plant Pathology 

0405 Plant Pharmacology 

0406 Plant Physiology 

0407 Zoology, General 

0408 Pathology, Human and Animal 

0409 Pharmacology, Human and Animal 

0410 Physiology, Human and Animal 

0411 Microbiology 

0412 Anatomy 

0413 Histology 

0414 Biochemistry 

0415 Biophysics 

0416 Molecular Biology 

0417 Cell Biology (Cytology, Cell Physiology) 

0418 Marine Biology 

0419 Biometrics and Riostatistics 

0420 Ecology 

0421 Entomology 

0422 Genetics 

0423 Radiobiolony 

0424 Nutrition, Scientific 

(exclude Nutrition in Home Economics 
and Dietetics) 
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0425 Neuroscicnces 

0426 Toxicology 

0427 Embryology 
0499 Other, Specify 

0500 BUSINESS AND MANAGEMENT 

0501 Business nnil Commerce, General 

0502 Accounting 

0503 Business Slalislics 

0504 Banking nnd Finance 

0505 Invcsimenis and Securities 

0506 Business Management and Administration 

0507 Operations Research 

0508 Hotel aitd Restaurant Management 

0509 Marketing and Purchasing 

0510 Transportation and Public Utilitiet 

0511 Real Estate 

0512 Insurance 

0513 International Business 

0514 Secretarial Studies 

0515 Personnel Management 

0516 Labor and Industrial Relations 

0517 Business Economics 
0599 Other* Specify 

0600 COMMUNICATIONS 

0601 Communications, General 

0602 Journalism (Printed Media) 

0603 Radio/TV 

0604 Advertising 

0605 Communication Media 

(use of videotape, film, etc., 
oriented specifically toward radio/TV) 

0699 Other, Specify 

0700 COMPUTER AND INFORMATION SCIENCES 

0701 Computer and Information Scienceti General 

0702 ' Information Sciences and Syitemi 

0703 Data Processing 

0704 Computer Programming 

0705 Systems Analysis 
0799 Other, Specify 

080Q EOUCATION 

ORO'I Education, general 

0802 Elementary education, general 

0803 Secondary education, general 
0R04 Junior high school education 

0805 Higher education, general 

0806 Junior and community college education 

0807 Adult and continuing education 

0808 Special education, general 

0809 Administration of special education 

0810 Education of the mentally retarded 

081 1 Education of the gifted 

0812 F.ducittion of the deaf 

0813 Education of the culturally disadvantaged 

0814 Education of the visually handicapped 

0815 Speech correction 

0816 Education of the emotionally disturbed 

0817 Remedial education 



0818 Special learning disabilities 

0819 Education of the physically handicapped 

0820 Education of the multiple handicapped 

0821 Social foundations (history and philosophy 

of education) 

0822 Educational psychology (include learning 

theory) 

0823 Pre-clementary education (kindergarten) 

0824 Educational statistics and research 

0825 Educational testing, evaluation, and 

measurement 

0826 Student personnel (counseling and guidance) 

0827 Educational administration 

0828 Educational supervision 

0829 Curriculum and instruction 

0830 Reading education (methodology and theory) 

0831 Art education (methodology and theory) 

0832 Music education (methodology and theory) 

0833 Mathematics education 

(methodology and theory) 

0834 Science education (methodology and theory) 

0835 Physical education 

0836 Driver smd safety education 

0837 Health education (include family life 

education) 

0838 Business, commerce, and distributive education 

0839 Industrial arts, vocationali and technical 

education 
0899 Other, specify 

0900 ENGINEERING 

0901 Engineering, General 

0902 Aerospnce, Aeronautical* ^nd 

Astronautieal Engineering 

0903 Agricultural Engineering 

0904 Architectural Engineering 

0905 Bioenginccring and Biomedical Engineering 

0906 Chemical Engineering (include Petroleum 

Refining) 

0907 Petroleum Engineering (exclude Petroleum 

Refining) 

0908 Civil, Construction, and Transportation 

Engineering 

0909 Electrical, Electronics, and Communications 

Engineering 

0910 Mechanical Engineering 

0911 Geological Engineering 

0912 Geophysical Engineering 

0913 Industrial and Management Engineering 

0914 Mctsilhirgical Engineering 

0915 Mnterials Engineering 

0916 Ceramic Engineering 

0917 Textile Engineering 

0918 Mining and Mineral Engineering 

0919 Engineering Physics 

0920 Nuclear Engineering 

0921 Engineering Mechanics 

0922 Environmental and Sanitary Engineering 

0923 Naval Architecture and Marine Engineering 

0924 Ocean Engineering 
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0925 Engineering Technologies 

0999 Oilier, Specify 

'1000 FINE ANO APPLIED ARTS 

tool Fine Arts, Ciencnil 

1002 Art (Painlinp, Dniwing, Sculpture) 

1003 An History nnd Appreciation 

1004 Music (Performing. Composition, Theory) 

1005 Music (Liberal Arts Program) 

1006 Music History and Appreciition 

(Musicology) 

.1007 Dramatic Arts 

1008 Dance 

1009 Applied Design 

(Ceramics, Wctavlng. Textile Design, 
Fashion Design, Jewelry, Metalsmitbiog, 
Interior Decoration, Commeicial Art) 

1010 Cinematography 

1011 Photography 
1099 Other, Specify 

1100 FOREIGN LANGUAGES 

1101 Foreign Languages, General 

1102 French. * 

1103 German 

1104 Italian 

1105 Spanish 

1106 Russian 

1107 Chinese 

1108 Japanese 

1109 Latin 

I HQ Greek, classical 

nil Hebrew 

1112 Arabic 

1113 Indian (Asiatic) 

1114 Scandinavian Languages 

1115 Slavic Languages (other than Russian) 

1116 African Languages (non-Semilic) 
1199 Other, Specify 

1200 HEALTH PROFESSIONS 

1201 Health Professions, General 

1202 Hospital and Health Cait Administration 

1203 Nursing 

1204 Dentistry 

1205 Dental Specialties 

1206 Medicine 

1207 Medical Specialties 

1208 Occupational Therapy 

1209 Optometry 

1210 Osicopathic Medicine 

1211 Pharmacy 

1212 Physical Therapy 

1213 Dcntalilygienc 

1214 Public Health 

1215 Medical Record Librarianship 

' 1216 PoiJiatry or Podiatric Medicine 

1217 Biomedical Communlcalion 

. 1218 Veterinary Medicine 

1219 Veterinary Medicine Specialties 

1220 Speech Pathology and Audiology 

1221 Chiropractic 

1222 Clinical Social Work 

1223 Medical Laboratory Technologies 

1224 Dental Technologies 

1225 Radiologic Technologies 
1299 Other, Specify 



1300 HOME ECONOMICS 

1301 Home Hcononn'cs, General 

1302 Home Deconition and Hume Equipment 

1303 Cliilhing and Textiles 

13tl4 Consumer F.cnnomics and Home Manafgement 
1305 Family Relations and Child Development 
1306. Foods and Nutrition (include Dietetics) 
1307 Institutional Management and Cafeteria 

Management 
1399 Other, Specify 



1400 LAW 

1401 
1499 



Law, General 
Other, Specify 



1500 LETTERS 

1501 English, General 

1502 Literature, English 

1503 Comparative Literature 

1504 Classics 

1505 Linguistics (include Phonetics, Semantics, 

and Philology) 

1506 Speech. Debate, and Forensic Science 

(Rhetoric and Public Address) 

1507 Creative Writing 

1508 Teaching of English as a Foreign Language 

1509 Philosophy 

1510 Religious Studies (exclude Theological 

Professions) 
1599 Other. Specify 

1600 LIBRARY SCIENCE 

1601 Library Science, General 
1699 Other, Specify 

1700 MATHEMATICS 

1701 Mathematics, General 

1702 Statistics, Mathematical and Thedrcticil 

1703 Applied Mathematics 
1799 Other, Specify 

1800 MILITARY SCIENCES 

1801 Military Science (Army) 

1802 Naval Science (Navy, Marines) 

1803 Aerospace Science (Air Force) 
1899 Other, Specify 

1900 PHYSICAL SCIENCES 

1901 Physical Sciences, General 

1902 Physics. General (exclude Biophysics) 

1903 Molecular Physics 

1904 Nuclear Physics 

1905 Chemistry, General (exclude Biochemistry) 

1906 Inorganic Chemistry 

1907 Orgauie Clieiuistry 
190H PhyKical Chemistry 

1909 Analytical Chemistry 

1910 Pharmaeculical Chemistry 

1911 Astronomy 

1912 Astrophysics 

1913 Atmospheric Sciences and Meteorology 

1914 Geology ' 

1915 Geochemistry 

1916 Geophysics and Seismology 

1917 Earth Sciences, General 

1918 Paleontology 

1919 Oceanography 

1920 Metallurgy 
1999 Other, Specify 
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2000 PSYCHOLOGY 

2001 Psychology. General 

2002 Expcrimcntnl Psychology (animal and 

humnn) 

2003 Clinical Psychofogy 

2004 Psychology for Counseling 

2005 Social Psychology 

2006 Psychometrics 

2007 Statistics in Psychology 
200S TndustrinI Psychology 

2009 Dcvelopmcnlnl Psychology 

2010 Physiologic il Psychology 
2099 Other. Specify 

2100 PUBLIC AFFAIRS AND SERVICES 

2101 CommiinHy Services. General 

2102 Public Administration 

2103 Parks and Recreation Management 

2104 Social Work and Helping Services 

(other than Clinical Social Work) 

2105 Law Enforcement and Corrections 

2106 International Public Service 

(other than Diplomatic Service) 
2199 Other. Specify 

2200 SOCIAL SCIENCES 

2201 Social Sciences. General 

2202 Anthropology 

2203 Archeology 

2204 Economics 

2205 History 

2206 Geography 

2207 Political Science and Government 

2208 Sociology 

2209 Criminology 

2210 International Relations 

2211 Afro-American (Black Culture) Studies 

2212 American Indian Cultural Studies 

2213 Mcxican>American Cultural Sludiei 

2214 Urban Studies 

2215 Demography 
2299 Other. Specify 

2300 THEOLOGY 

2301 Thcologiciil Professions. General 

2302 Religious Music 

2303 Biblical Languages 

2304 Religious Education 
2399 Other. Specify 

4900 INTERDISCIPLINARY STUDIES 

4901 General Libcntl Arts and Sciences 
4*)i)2 llinlonic'il and Physical Sciences 
4W lliinianitics mid Sinrial Sciences 
4*W4 l-n(>inccring and Otiicr Disciplines 
4^m Other. S|H?cify 

5000 BUSINESS AND COMMERCE TECHNOLOGIES 

5001 Business and Cnmmcrcc Technologies. 

General 

5002 Accountinp Technologies 

5003 Bonking and I nance Technologies 

5004 Miirkcting, Distribution, Purchasing. Business. 

and industrial Management Technologies 

5005 Secretarial Technologies 

(include Office Machines Training) 

5006 Personal Service Technologies 



247 

283 



(Stewardess. Cosmetologist, etc.) 

5007 Photography Technologies 

5008 Communications and Broadc.isting 

Technologies (Radio/TV. Newspapers) 

5009 Printing and Lithography Technologies 

5010 Hotel and Restaurant Management 

Technologies 

5011 Transportation and Public Utility 

Technologies 

5012 Applied Arts. Graphic Arts, and Fine Arts 

Technologies (include advertising desitn) 
5099 Other. Specify 

5100 DATA PROCESSING TECHNOLOGIES 

5101 Data Processing Technologies. General 

5102 Key Punch Operator and Other Input 

Pix:paration Technologies 

5103 Computer Programmer Technologies 

5104 Computer Operator and Peripheral Equipment 

Operation Technologies 

5105 Data Processing Equipment Maintenance 

Technologies 
5199 Other. Specify 

5200 HEALTH SERVICES AND PARAMEDICAL 
TECHNOLOGIES 

5201 Health Services Assistant Technologies. 

General 

5202 Dental Assistant technologies 

5203 Dental Hygiene Technologies 

5204 Dental Laboratory technologies 

5205 Medical or Biological Laboratory Assistant 

Technologies 

5206 Animal l.aborafory Assistant Technologies 

5207 Radiologic Technologies (X-Ray. etc.) 

5208 Nursing. R.N. (less than 4-year program) 

5209 Nursing. Practical (L.P.N, or L.V.N.— leu 

than 4*ycar program) 

5210 Occupational Therapy TrchUologies 
52 It Surgical Technologies 

5212 Optical Technologies < include Ocular Caft. 
Ophthalmic. Optometric Technologies) 

5213 Medical Record Technologies 

5214 Medical Assistant and Medical Office 

Assistant Technologies 

5215 Inhalation Therapy Technologies 

5216 Psychiatric Technologies (include Mental 

Health Aide Programs) 

5217 Electro Diagnostic Technologies 

(include E.K.G.. E.E.G., etc.) 
52 IR Institutional Management Technologies 

(Rest Ilnmc. etc.) 
5219 Physical Therapy Teehnolnglcs 
5299 Other. Specify 

5300 MECHANICAL AND ENGINEERING TECHNOLOGIES 

5301 Mechanical and l*nginccring Technologies. 

General 

5302 Aeronautical and Aviation Technologies 

5303 Knginccrint: Graphics (Tool :md Machine 

Drafting and Design) 

5304 Architectural Drafting Technologies 

5305 Chemical Icchnologics (include Plastics) 

5306 Automotive Technologies 

5307 Diesel Technologies 

5308 Welding Technologies 



5309 Civil Technologies 

(Surveying, Phulugninmictry, etc.) 

5310 iliccironics anil Machine Technoloeiei 

(TV, Appliunce, Oflicc Machine Repair, 
etc.) 

5311 Electromechanical Technologies 

5312 Indiisirinl Technologies 

5313 Textile Technologies 

5314 Instnimeniation Technologies 

5315 Mechanical Technologies 

5316 Nuclear Technologies. 

5317 Construction and Building Technologies 

(Carpentry, Electrical Work, Plumbing, 
Sheet Metal, Air Conditioning, Heating, 
etc.) 

5399 Other, Specify 

5400 NATURAL SCIENCE TECHNOLOGIES 

540 ^ Nniural Science Technologies, General 
5402 Agriculture Technologies 
(include Horticulture) 
' 5403 Forestry and Wildlife Technologies 
(include Fisheries) 

5404 Food Services Technologies 

5405 Home Economics Technologies 

5406 Marine and Oceanographic Technologies 

5407 Laboratory Technologies, General 

5408 Sanitation and Public Health Inspection 

Technologies (Environmental Health 
Technologies) 
5499 Other, Specify 

5500 PUBLIC SERVICE RELATED TECHNQJ^OGIES 

5501 Public Service Technologies, General 

5502 Bible Study or Religion-Related Occupationa 

5503 Education Technologies (Teacher Aide and 

2-year Teacher Training Programs) 

5504 Library Assistant Technologies 

5505 Police, Law Enforcement, Corrections 

Technologies 

5506 Recreation and Social Work Related 

Technologies 

5507 Fire Control Technology 

5508 Public Administration and Management 

Technologies 
5599 Other, Specify 
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ALPHABETICAL LISTING 



For the user's convenience, the HEGIS discipline subcategories are listed 
below in alphabetical order. 



t 1: 



CONVENTIONAL ACADEMIC SUBDIVISIONS OF 
KNOWLEDGE AND TRAINING 



Title 



Code 



Accounting 0502 

Administration, business 0506 

Administration, educational 0827 

Administration, public 2102 

Administration, special education 0809 

Adult education 0807 

Advertising 0604 

Aeronautical engineering 0902 

Aerospace engineering „ 0902 

Aerospace science 1803 

African languages (non-Semitic) 1116 

African studies 0305 

Afro«American studies 2211 

Agricultural business 0112 

Agricultural economics 0111 

Agricultural engineering 0903 

Agricultural management 0110 

Agriculture, general 0101 

Agriculture tcchn|logies 0116 

Agronomy | 0102 

American Indian Cultural studies 2212 

American studies^. 0313 

Analytical chemistry ....1909 

Anatomy „ ....0412 

Animal science „ 0104 

Anthropology 2202 

Applied design 1009 

Ai^plicd mathematics 1703 

Arabic 1112 

Archeology 2203 

Architectural engineering 0904 

Architecture 0202 

Architecture, naval » 0923 

Art 1002 

Art appreciation 1003 

Art, commercial 1009 

Art education 0831 

Art history 1003 

Asian studies, general » 0301 

Astrniiautical engineering 0902 

Astronomy 1911 

Astrophysid 1912 

Anuosphcric sciences 191.1 

Audiology 1220 

ll:iclci iolopy ' 0403 

ll.inking ... . li.C , 0504 

llibliciil l.mgu:igcs 2303 

nicchcmistry 0414 

IlitKnpinccring 0905 

Hinlopi'cal and phvsical sciences (interdisciplinary) 4902 

Biology, cellular 0417 

lliology, general 0401 

Biolopy, marine 0418 

Biology, molecular 0416 
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Biomedical communication 1217 

Biomedical engineering 0905 

Biometrics 0419 

Biophysics .0415 

Bidstatistics 0419 

Black culture studies 2211 

Botany, general 0402 

Business administration 0506 

Business, agricultural oil2 

Business economics '.„!'.]"o517 

Business education !!!!.".".'.!..7.!o838 

Business, generol .".'.'.0501 

Business, international ^ ...0513 

Business management ...'.!!!.050'5 

Business statistics .'!!.'!.'.'.'!!o503 

Cafeteria management 1307 

Catalan '.."!'.!.! 199 

Oil biology !.«'.!.'.!.'!.'.'.'04I7 

Cell physiology .!!!."..0417 

Ceramic engineering 09I6 

Ceramics 1009 

Chemical engineering "!.".'!.'". !o906 

Chemistry, general 1 905 

Child development .'"!!! 1 305 

Chinese JI07 

Chiropractic - !!"...'.!!!! 1 22 1 

Cinematography .'!.'.'.'.'.'..'.'"!.'.'. 10 10 

City planning , .Z.!.!o206 

Civil engineering 0908 

Classics ■/i504 

Clinical psychology 2003 

Clinical social work !!."!l222 

Clothing ..'.'...'.....1303 

Commerce education 0838 

Commerce, general !!!!..""!.0501 

Commercial art .!!!l009 

Communication media .0605 

Communications, general O6OI 

Communications engineering 0909 

Community college education 0806 

Community planning .0206 

Community services, general [2 101 

Comparative literature 1503 

Computer programming .!.!.0704 

Computer sciences, general 0701 

Constniction engineering 0908 

Consumer economics 1304 

Continuing education '....!0807 

Corrections .."2105 

Coumeliug, educational " '.M2(i 

Counseling, psychology for ^20(M 

CrcMtivc writing , 1507 

Criniiuology !!2209 

Crop management ..0102 

Curriculum 0829 

Cytology !!!..Z04I7 

Dairy sciences 0105 

iil008 

Danish 1114 

Data processing ."...'""o703 

Debate 1505 



Dcniogniphy 2215 

Dcntiil hy|!icnc 1213 

Dv*nlal specialties .1205 

IX'ntal Icclinoloi'ic.s 1224 

Dcnitslry, D.D.S. or D.M.D. ilcgicc 1204 

Dcvclopmcniiil psychology ?.0O9 

Dietetics : 1306 

Dislrthtilive education ...OJ<38 

Dramatic arts 1007 

Drawing 1002 

Driver educnlion 0.S36 

Earth sciences, general ,.1917 

East Asian sluilies 0302 

Eastern Huropean studies 0311 

Ecology 0420 

Economics 2204 

Economics, agricultural 0111 

Economics, business 0517 

Education of the culturally disadvantaged ..Q813 

Education of the deaf 0812 

Education of the emotionally disturbed 0816 

Education, general 0801 

Education of the gifted , 0811 

Education of mentally retarded 0810 

Education of the multiple handicapped 0H20 

Fducation of the physically handicapped 0819 

Education, religious 2304 

Education of the visually handicapped 0814 

Educational administration 0827 

Educational evaluation , 0825 

Hducalioniil measurement 0825 

Fducalional psychology 0822 

Educational research 0824 

Educational statistics 0824 

Educational supervision ^ 0828 

Educational testing 0825 

Electrical engineering 0909 

Electronics engineering 0909 

Elementary education, general 0802 

Embryology 0427 

Engineering, general 0901 

Engineering, mechanics , 0921 

Engineerini! and other disciplines (interdisciplinary) ....4904 

Engineerihi; physics 0919 

Engineerinir technologies 0925 

EngIKh as a foreign language 1508 

English, general ...1501 

English, literature 1502 

Entomology 0421 

EnvironmcDtal design, general 0201 

HnvironmcDtid engineering 0922 

European studies, general 0310 

Exturi mental psychology (animal and human) 2002 

l-amily life education 0837 

l-:imily relations ...„...1305 

l-aiui management ?rrS.*.OIli) 

t-:ishion design 1009 

Tic Id crops 010^^^ 

Finance , 0504 

Fine arts, general 1001 

Finnish 1199 

Fish management oro7 

Floriculture 0109 

Foods and nutrition 1306 

Food .science 0113 
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Hood technology 0113 

Foieigu languages, general |10I 

Foivnsie science 1506 

Forislry ..!.!oil4 

Forestry technologies 0116 

Freiieli \\q2 

Fruit production 01O8 

Game management 0107 

General liberal arts and .sciences (interdisciplinary) ....4901 

Genetics 0422 

Geochemistry 1915 

Geo;*raphy 2206 

Geological engineering 0911 

Geology ^ "!...1914 

Geophysical engineering 0912 

Geophysics 19|6 

German ||03 

Government 2207 

Greek, classical mo 

Guidance, education 0826 

Heatlh care administration .\I202 

Health education 0837 

Health professions, general 1201 

Hebrew im 

Helping services 2104 

Higher education, general 0805 

Histology 0413 

History ...2205 

History of education 0821 

Home decoration 1302 

Home economics, general 1301 

Home equipment 1302 

Home management , 1304 

Horticulture ^ 0IO8 

Hospital administration 1202 

Hotel management 0508 

Humanities and social sciences (interdisciplinary) 4903 

Husbandry, animal 0104 

Husbandry, dairy 0105 

Ichthyology , , 0499 

India studies 0303 

Indian (Astatic) , II13 

Industrial arts education 0839 

Industrial engineering 0913 

Industrial psychology ,...2008 

Industrial relations 0516 

Information sciences ^ 070*2 

Information sciences, general 0701 

Information systems 0702 

Inorganic cliemistry 1906 

Institutional management 1307 

Instruction 0829 

Insurance 0512 

Interior decoration 1009 

Interior design 0203 

International business 0513 

International public service 2106 

International relations 2210 

Investments 0505 

Islamic studies ^ 0.306 

Italian 1104 



Japanese II03 

Jewelry ,009 

Journalt^in 0602 

Junior college editcalton ....""!..!"!o806 

Junior high school education ..".!!.".""0804 

K' iergarlen education *...0823 

Korean 1199 

Labor relations 0516 

Landscape architecture 1.0204 

V^^l" : Z;Zll09 

Latin Anerican studies 0308 

Law enforcement !.2105 

Law. gc leral ".1401 

Learnin( theory !.!..""...0822 

Liberal arts and sciences (interdisciplinary) 4901 

Library science, general 1501 

Limnolo'iy 0499 

Linguisti:s ."l505 

Literature* comparative ..1503 

Literature English 1502 

Mnnngei icnl, business 0506 

Managencnt, engineering ..0913 

Marine -oology ..04l8 

Marine engineering 0923 

Marketing "!"!!!.!!!!o509 

Materials engineering ."0915 

Mathematics, applied 1703 

Mathematics, education 0833 

Mathematics, general ."!!!701 

Mathematics, statistics .....1702 

Mechanical engineering 0910 

Medical laboratory technologies ..Z!j223 

Medical record librarianship 12I5 

Medical specialties ".1207 

Medicine, M.D. degree ...."!..... 1206 

Metallurgical engineering 0914 

Mcfalkirgy , [""'' \ 920 

Mctalsmithing ""!!l009 

Meteorology 19 13 

Mexican-American cultural studies 2213 

Microbiology ...."0411 

Middle Eastern studies 0309 

Military science 1801 

Mineral engineering 0918 

Mining engineering !...0918 

Molcculrr biology !"!.0416 

Molccuirr physics 1903 

Music (liberal arts program) ^i.? !l005 

Music apprcciatron |006 

Music, Cf^nposition 1004 

Music ctliication !.0832 

Mu^ic history ;. lOOg 

Music, performing 1004 

Music, theory 1004 

Musicology IOO6 

Natural resources management 0115 

Naval architecture 0923 

Naval science |802 

Neurosciences , 0425 

Norwegian 1114 

Nuclear engineering 0920 



Nuclear physics 1904 

Nursery science 0109 

Nursing (baccalaureate and higher programs) 1203 

Nutrition, scientific 0424 

Occupational therapy 12O8 

Ocean engineering 0924 

Oceanography 1919 

Operations research 0507 

Optometry 1209 

Organic chemistry 1907 

Ornamental horticulture 0109 

Ornithology .5.0499 

Osteopathic medicine, D.O. degree 12 10 

Pacific area studies .03 14 

Painting ..!!l002 

Paleontology 1918 

Parasitology 0499 

Park management 2103 

Pathology, animal 0408 

Pathology, human 0408 

Pathology, plant 0404 

Pcrsonnol management 0515 

Petroleum engineering 0907 

Petroleum refining !!!o906 

Pharmaceutical chemistry 1910 

Pharmacology, animal , 0409 

Pharmacology, human 0409 

Pharmacology, plant .0405 

Pharmacy |2li 

Philology , J 505 

Philosophy 1509 

Philo.sophy of education 0821 

Phonetics 1505 

Photography , ioi| 

Physical chemistry 1908 

Physical education 0835 

Physical sciences, general |90| 

Physical therapy : 12 12 

Physics, general ^ 1902 

Physiological psychology 2010 

Physiology, animal 0410 

Physiology, human 0410 

Physiology, plant . ..0406 

Plant pathology 0404 

Plant pharmacology 0405 

Plant physiology !.!.!!"!o406 

Podiatry |2|6 

Political .science 2207 

Poultry science 0106 

Prc-clenicniary education (JS23 

Programming, computer 0704 

Psychology, clinical 2003 

Psychology for counseling 2001 

Psychology, dc^^lopmemaK,.. 2009 

Psycholog^f^tfmicalion ^ OS 2 2 

PpchoWSgy, general 2001 

"r^chology, industrial 2008 

Psychology, physiological 2OIO 

Psychology, social 2005 

Psychomclrics 20O6 

Public address ] 1506 

Public administration 2102 

Public health 1214 

Public utilities 0510 

Purchasing 0509 
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ttailio ; 0603 

Kadinbiulo^y 0423 

RsutioUigic technologies 1225 

K;ingc inami|icnicnt 0117 

Kciiding education 0830 

Real estate 0511 

Recreation management 2103 

Regional planning 0206 

Rehabilitation services 1222 

Religious education 2304 

Religious music 2302 

Religious studies 1510 

Remedial education 0817 

Restaurant management 0508 

Rhetoric 1506 

Russian 1106 

Russian studies 0307 

Safety education 0836 

Sanitary engineedng 0922 

Sanskrit 1199 

Scandinavian languages 1114 

Science education 0834 

Sculpture 1002 

Secondary education, general 0803 

Secretarial studies 0514 

Securitie^r=>w..^^ 0505 

Seismology 1916 

Semantics 1505 

Slavic languages (other than Russian) 1115 

Slavic studies ^ 0307 

Social foundations of education 0821 

Social sciences, general 2201 

Social psychology „ 2005 

Social work 2104 

Sociology 2208 

Soil conservation 0103 

Soil management 0103 

Soil science 0103 

South Asian studies 0303 

Southeast Asian studies 0304 

Spanish 1105 

Special education, general 0808 

Special learning disabilities 0818 

Speech 1506 

Speech correction 0815 

Speech pathology 1220 

Statistics, muthemattcal and theoretical 1702 

Statistics in psychology 2007 

Student personnel 0826 

Swedish 1114 

Systems analysis 0705 

Systems, information « 0702 

Teaching of Fnglisli as a foreign language 1508 

Technical education 0839 

Television 0603 

"Textile design 1009 

Textile engineering .0917 

Textiles, home economics 1303 

Theological professions, general 2301 

Toxicology ^ 0426 

Transportation 0510 

Transportation engineering .0908 



. Urban architecture 0205 

Urban studies : 2214 

Vegetable production 0108 

^ Veterinary medicine, D.V.M. degree 1 21ft 

Veterinary medicine specialties 1219 

Vietnamese 1199 

Vocational education 0839 

Weaving 1009 

West European studies 0312 

Wildlife management 0107 

Writing, creative 1507 

Zoology, general 0407 



Part II: 

TECHNOLOGICAL AND OCCUPATIONAL CUR* 
RICULUMS LEADING TO ASSOCIATE DEGREES 
AND OTHER AWARDS BELOW THE 
BACCALAUREATE 



Title Code 

Accounting technologies 5002 

Advertising design technologies 5012 

Advertising technologies 5004 

Aeronautical technologies 5302 

Agriculture technologies 5402 

Air conditioning technologies 5317 

Airport management technologies 5004 

Animal laboratory assistant technologies 5206 

Appliance repair technologies 5310 

Applied arts technologies 5012 

Architectural drafting technologies 5304 

Automotive technologies 5306 

Aviation technologies • 5302 

Banking technologies 5003 

Bible study 5502 

Biological laboratory assistant technologies 5205 

Broadcasting technologies 5008 

Building tethnologtes 5317 

Business management technologies 5004 

-Business technologies, general 5001 

Carpentry technologies 5317 

CItentical technologies 5305 

Civil technologies 5309 

Comuicrce technologies, general 5001 

Communications technologies 500H 

Computer operator technologies 5104 

Computer, peripheral equipment 

ope nit ion technologies 5104 

Computer programmer technologie.^ 5103 

Construction technologies 5317 

Corrections technologies 5505 

Cosmetologist 5006 
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D.ila processing equipment 

matnlennnce technologies 5105 

Dala processing lechnolog/es, general J 101 

Denial assislani leciinologtes ^ 5202 

Denial hygiene lechnologtes , 5203 

Denial laboralory lechnologtes 5204 

Diesel lechnologies 5307 

Disiribitlton lechnologies 5004 

Drafting, architectural 5304 

Education lechnologies 5503 

Elccirlcian lechnologies 5317 

Elcciro diagnpslic technologies 5217 

Elecltomcchanical lechnologies 5311 

Eleclronics and machine technologies 5310 

Engineering graphics 5303 

Engineering technologies, general 5301 

Environmental health technologies 5408 

Finance lechnologies 5003 

Fine arts technologies 5012 

Fire control technology 5507 

Fisheries lechnologtes 5403 

Food services technologies 5404 

Forestry technologies 5403 

Graphic arts lechnologies 5012 

Health services assistant technologies, general 5201 

Healing lechnologies 5317 

Home economics technologies 5405 

Horticulture technologies 5402 

Hospital food service technologies 5404 

Hotel management technologies 5010 

Industrial management technologies 5004 

Industrial lechnologies 5312 

Inhalation therapy technologies 5215 

Input preparation technologies 5102 

Institutional management technologies 5218 

inslrumentation technologies 5314 

Insurance technologies 5004 

Key punch operator technologies 5102 

Laboratory technologies, general 5407 

Landscape technologies 5402 

Law enforcement technologies 5505 

Lihrnry assislnnt technologies 5504 

l.illio|:raphy trchnotoj^ics 5009 

Machine draffiiir Juul ((csi);n technologies , 5303 

Machtne npair IcchiitOiM^ies 5310 

Martnii cc|titpMicnl Icchnoloplcs 5004 

Marine technologies 5406 

Marketing technologies 5004 » 

Mcclianieal lechnologies * 5315 

Mechanical teehnolopics. general 5301 

Medical assistant technologies ^ 5214 

Medical laboratory assistant technologies 5205 

Medical oflice assistant technologies 5214 

Medical record technologies 5213 

Mental health aide programs 5215 



Natural science technologies, general 5401 

Newspaper communication technologies 5008 

Nuclear technologies 53 1 6 

Nursing, practical (L.P.N, or L.V.N.) 5209 

Nursing R.N. preparation 5208 

Occupalional therapy technologies 5210 

Oceanographic lechnologies 5406 

Ocular care lechnologies 5212 

Office machine repair technologies 5.^10 

Oflfice machine training 5005 

Ophthalmic technologies 5212 

Optical technologies 5212 

Optometric technologies 5212 

Personal service technologies 5006 

Personnel management technologies .S004 

Photograinmetry lechnologies 5309 

Photography technologies 5007 

Physical therapy technology 5219 

Plastic^ lechnologtes 5305 

Plumbing technologies 5317 

Police technologies , 5505 

Printing technologies 5009 

Programmer* technologies 5103 

Psychiatric technologies : 5216 

Public administration and management technologies ....5508 

Public health inspection technologies 5408 

Public service technologies, general 5501 

Public utility technologies 5011 

Purchasing technologies 5004 

Radio broadcasting technologies 5008 

Radio repair technologies , 5310 

Radiologic technologies ..5207 

Real estate technologies , 5004 

Recreation technologies 5506 

Religion related occupations .5502 

Rest home management technology 5218 

Restaurant management technologies 5010 

Sales technologies 5004 

Sanitation technologies 5408 

Secretarial technologies 5005 

Sheet metal technologies ,...5317 

Social work related technologies 5506 

Stewardess preparation .v ^ 5006 

Surgical technologies 5211 

Surveying technologies .....5309 

Teacher aide preparation 5.503 

Telcvisimi hioadeaMitm technologies 5008 

Television repair lechnologies 5310 

Texlile teehnolojties 5313 

Tool design lechnologies 5303 

Transportation technologies 501 1 

Welding technologies 5308 

Wildlife technologies ....5403 

X-ray technologies, 5207 
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APPENDIX D 

Guidelines for Developing and Implementing 
Questionnaire Surveys 
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Guidelines for Developing and Implementing 
Questionnaire Surveys* 



The need to develop and use questionnaire surveys for acquiring a wide range 
of information about the outcomes of postsecondary education is referenced 
throughout Sections II, III, and IV of the Outcome Measures and Procedures 
Manual . The purpose of this appendix is to provide a brief overview of the 
major steps to be taken in any questionnaire survey effort and to review some 
of the key questions that must be considered at each step. Incorporated in 
the discussion are some "how to do it" suggestions regarding such things as 
survey design, questionnaire construction, and report writing. It should be 
noted at the outset, however, that in no way does this appendix cover all the 
things there are to know about questionnaire survey development and implemen- 
tation. Rather it is intended to serve as a reminder of the minimum requirements 
that are paramount in any survey effort. 

Major Steps and Key Questions 

Step 1; Establishing the Purpose of the Survey 

As defined by A. N. Oppenheim (1973) a survey is a planned data collection 
effort for the purpose of description or prediction as a guide to action or 
for the purpose of explaining the relationships between two or more variables, 
e.g., the relationship between student academic achievement and student per- 
formance on a job. While most survey researchers will attest that in practice 
there are as many purposes as there are surveys, they also will agree that 
foremost in any survey effort is the development of a clear definition and 

*From a paper by Sidney S. Micek, NCHEMS, 1975. 
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understanding of the objectives of the survey. To achieve this end, it is 
essential that the first step to be taken in a survey is the delineation and 
clarification of the specific problems to be studied, the critical questions 
to be answered, and the possible uses to be made of the survey results. The 
reason this step is so central to every survey is the fact that once this 
initial step is accomplished, a11 of the remaining steps in the survey process 
are "means to an end" and will flow logically from the purpose of the study 
identified in this step. 

In establishing the purpose of the survey, it is important to obtain input 
from those persons who will use the findings from the study. Of course, the 
larger the group of persons from which input is sought, the greater will be 
the diversity of what may constitute the objectives of the study. Generally, 
the more objectives a study has to accomplish, the greater its complexity and 
cost, therefore, it may be critical to set priorities as to the objectives 
that will be most important to achieve, given certain time and monetary 
constraints. 

In addition to identifying the specific purposes or objectives of the survey 
in this initial step, two other key questions should be considered: 

• What concepts need to be defined before the survey process continues ? 
In the formulation of any survey effort, certain concepts are used 
to communicate and organize one's thinking relative to the problems 
or questions in focus. For example, in a survey of former students 
one question of interest might concern their satisfaction with their 
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vocational preparation. What is meant by the concepts, "satisfaction" 
and "vocational preparation," in this context needs to be translated 
into specific terms so everyone clearly understands what constitutes 
the acceptable indicators of these concepts. 

t What assumptions will be made? 
In many surveys it is impossible to control all elements of the 
survey, e.g., the validity of certain parts of a questionnaire or 
the adequacy of the sample. Therefore, formulating the assumptions 
of a survey is an important consideration since they may affect the 
survey process as well ai the interpretation of the survey results. 

Step 2; Developing the Survey Plan 

Generally speaking, there are four basic purposes for which a survey is carried 
out: 

1. To describe something, 

2. To explain something, 

3. To predict something, or 

4. To explore something. 

Very often surveys are designed to meet more than one of these objectives. 
For example, it is not uncommon to conduct a follow-up study of college 
graduates to obtain information about their current level of educational 
attainment and occupational status (i.e., description) and their educational 
needs now that they have left the institution (i.e., exploration). Once the 
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purposes of the survey have been clearly delineated, the next key step is* to 
develop the plan of action for conducting the study. The most appropriate is 
the one that ensures a logically tight and efficient plan so that clear answers 
to the questions or hypotheses of interest can be obtained. 

In developing the survey plan the following key questions need to be considered 
t What wiTl be the "units of analysis" under study ? 
One of the first questions in laying the plans to be followed in 
a survey is to determine the "things" under study in the survey. 
Babbie in his book. Survey Research Methods (1973), has referred 
to the things under study in a given survey as the "units of 
analysis." The primary reason it is so important to identify 
the different units of analysis in a survey is that data will 
need to be collected to provide information about each unit of 
analysis identified. For example, a follow-up study of former 
students (graduates and nongraduates) might be aimed at acquiring 
information about (1) the marital status of the former students, 
(2) the salary level of former students who are heads of house- 
holds, and (3) the mean annual combined income of former students' 
families. In these examples, the units of analysis would be, 
respectively, individual former students, former students who are 
heads of households, and former students' families. As Babbie 
(1974: 61) points out. 

Whatever the nature of the data used to describe the 
units of analysis, it is important that they be identified 
in advance. Otherwise the sample design and the data collection 
methods may prohibit the analysis appropriate to the study. 
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• What types of survey design will be needed ? 
Having determined the purposes and the units of analysis for the 
study, the next key concern is selecting the design for the study. 
The best design is the one that arranges the conditions for data 
collection and analysis in such a way to "combine relevance to 
the research purpose with economy in procedure" (Selltiz, Jahoda, 
et al, 1951). As a result, survey designs will differ depending 
on the purposes of the study and the time and monetary constraints. 

In determining the best design for a given survey, two basic 
types of design can be considered: 

1. A Cross-Sectional Design — a plan for collecting data at 
a given point in time to describe, explain, predict, or 
explore certain aspects or relationships about a larger 
population at that poin4 ip time. 

2. A Longitudinal Design- ta plan for collecting and analyzing 
data over multiple points in time to describe, explain, 
predict, or explore changes in a given population over 
time. 

There are variations to both of thesei basic designs that can be 
considered. For instance in a longitudinal study, a decision might 
have to be made about whether to study the same sample of a given 
group of students over time or to study different samples of a 
given group of students over time. 
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The references presented at the end of this appendix under the 
heading "Study Designs" provide extensive discussion about the 
strengths and weaknesses of different design alternatives. 

• Shou1<l^a sample be drawn? 
A survey sample represents a subgroup of elements (e.g., a small 
group of students) that has been selected from a larger population 
(e.g., all the students enrolled in the college) for the purpose 
of finding out something about the population from which they have 
been taken. Most survey efforts in postsecondary education require 
some type of sampling. The reasons for this are threefold. Probably 
the mOSit obvious reason is that it is less expensive to survey a 
sample of a large population. A second reason for sampling is that 
it saves a great deal of time in terms of data collection and data 
processing. The final major reason for sampling is that it is 
usually more efficient than a survey of the entire population since 
it allows for the development of higher quality instruments and 
the data collected are more manageable. 

§ What kind of sample should be selected? 
Basically, two types of samples can be considered: (1) probability 
samples and (2) nonprobability samples. The important difference 
between these two types of samples is that probability samples are 
based on the use of random sampling in the selection of elements 
from the larger population. 
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In choosing between these two basic types of sampling approaches, 
one needs to assess the advantages and disadvantages of each. 
Probability samples are intended to avoid biases in the selection 
of the elements of the population by making sure a11 elements have 
an equal chance of selection. Such a guarantee allows the researcher 
to assume that the sample wi11 closely resemble the population. A 
second advantage of probability samples is that they permit estimates 
of sampling error. Nonprobability samples, on the other hand, are 
apropos when probability sampling is too expensive or when it is 
impossible to apply the random selection process because the 
elements of the population cannot be enumerated. 

Some important varieties of probability samples include simple 
random samples, stratified random samples, and duster samples. 
Variations in nonprobability samples include quota samples and 
purposive samples. Detailed discussion about these sampling 
alternatives can be found in the references suggested under the 
heading "Survey Sampling" at the end of this appendix. 

§ How large should survey samples be? 
While the size of a samp1e(s) depends on a number of factors, 
generally it should be large enough to obtain a sufficient number 
of responses to make some reliable conclusions. According to 
Kish (1965: 217): ^ 
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Exact control of sample size is unnecessary and impossible 
in most situations. It may be too difficult to obtain either 
the information or procedures for firmly controlling even 
the initial sample size. Moreover, nonresponses and subclasses 
introduce additional sources of variation. We should aim at 
an approximate control that is both feasible and desirable. 
The degree of control depends on the situation. . . . 



Because the answer to this key question depends on the situation at 
hand, any further discussion here may be more confusing than helpful. 
As a result, one should consult the selected references on Sampling 
Methods presented at the end of this appendix. 



Step 3: Developing the Survey Questionnaires 

Because the use of self -report survey questionnaires is suggested so often 
throughout Sections II, III, and IV of the manual as the best means for 
collecting many of the outcomes measures listed therein, the following 
discussion focuses on key questions related to the development of this 
type of data-gathering instrument.* 



t How should the questionnaire be designed? 
The format of any questionnaire should be attractive to the respondents. 
This is a most important ingredient in achieving a high response rate. 



*In-person or telephone interviews can also be useful in obtaining a wide range 
of outcome information. Their major limitation is that they are so time con- 
summing. Two excellent references to review concerning this technique are: 

1. Raymond L. Gordon, Interviewing: Strategy Techniques 
and Tactics . Homewood, 111.: Dorsey Press, 1969. 

2. Robert L. Kahn and Charles F. Conriell, The Dynamics of 
Interviewing . New York: John Wiley and Sons, Inc., 1967. 

300 

2BZ 



The following is a list of suggestions for making a questionnaire 
attractive: 

1. Keep the questionnaire as brief as possible."^ 

2. Use quality paper and printing whenever possible. 
Make sure the printing is not too small for the 
respondent to read. 

3. Design the cover of the questionnaire so that it is 
distinctive, aesthetically appeal ing, and simple to read. 

4. Make it easy for the respondents to record their answers. 

5. Have a logical and easily followed order and organization 
of questions. For example, provide dear instructions 
when subsequent questions are contingent on an earlier 

> question(s). 

6. Present the questions so that plenty of "white space" 
shows between the items (don't clutter the questionnaire). 

A final point to be considered in questionnaire design is how the 
questionnaire wi11 be coded once it is returned. For example, if 
the responses are to be keypunched directly^rom the questionnaire, 
the developer wi11 need to make sure the keypuncher can easily and 
reliably recognize the number or alphabetic character assigned to 
the questionnaire items and their associated response options. 

"^In a situation where the number of questions to be asked of respondents is 
lengthy, one may want to consider giving parts of the questionnaire to different 
samples of the same population in order to keep reasonable the length of the 
questionnaire that anyone has to answer. 




(A good rule to follow is have the draft of the questionnaire 
reviewed by a data processing expert to make sure it can be 
accurately keypunched.) 

• Should open-ended or closed-ended items be used? 
The decision about whether or not to use an open-ended item (in 
which the respondent si^pplies his or her own answer), a dosed- 
ended item (in y^hich the respondent selects his or her answers 
from the list supplied by the in/estigator), or both types will 
depend on the type that best serves the purpose(s) one has in mind. 
Whitney (1972) has listed the following advantages for each type 
of item. 

The advantages of open-ended items are that they: 

1. Are subject to little influence of the investigator. 

2. Elicit a wide variety or responses. 

3. Are useful for introducing subjects of new parts of the 
questionnaire. 

4. Provide background for interpreting results. 

5. Give respondents a chance to "have their say." 

6. Are more "courteous." 

7. Can aid in drafting questions and coding responses 
(when used in pilot work). 

8. Give "sparkle" and credibility to your final report. 
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On the other hand, the advantages of closed-ended Items are 
that they: 

1. Are Interperted more uniformly by respondents. 

2. Produce easily tabulated responses. 

3. Are unaffected by the respondent's verbosity. 

4. Eliminate some problems of vocabulary and definitions. 

5. Allow more questions to be asked. 

• How should questionnaire Items be worded? 
The wording of questionnaire Items Is extremely Important to ensure 
that the respondents w111 be w1111ng to and capable of answering them 

^ In an honest and accurate way. This means that the Items must be 
clear and unambiguous so the respondents understand exactly what the 
investigator wants to know. To achieve this objectlye, the following 
points should be considered: 

1. To the exti^nt possible. Items should be kept short. Items 
that are too long often w111 cause the respondent to forget 
the purpose of the questions In focus. Further, lengthy Items 
can cause fatigue and Impatience among respondents which. In 
turn, may affect questionnaire reliability and response rate. 

2. In writing the Items, keep the language simple, dear, and 
straightforward. A good rule to follow Is write the Item 

so that the respondent feels you are treating him or her with 
respect and courtesy. 
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3. To the extent possible, items should be stated in the form of 
simple sentences rather than in the form of compound or complex 
sentences. 

4. Caution should be taken to avoid biased words or phrases that 
may influence a respondent to answer one way or another. 

5. If questionnaire items offer alternative responses to be 
checked by the respondent, the set of responses should 
include all possible and distinct responses to the question 
in focus to avoid confusion (i.e., the set of responses 
should be exhaustive and mutually exclusive). 

6. The need to avoid "double-barreled" questions is another 
important consideration in item wording. For example, 
asking respondents to agree or disagree with statements 
such as "Micro University should continue to strive for 
excellence in the liberal arts and excellence in its career- 
oriented programs" should be avoided. Some persons may not 
be able to respond because they might favor an emphasis in 
the liberal arts curriculum but be violently opposed to any 
career-oriented curricula or vice versa. Furthermore, if they 
did answer, the responses of such persons would be misleading. 
Babbie (1973: 142) suggests that whenever the word "and" 
appears in a questionnaire item, the item should be checked 

to determine if it is a double-barreled one. 



In developing the questionnaire items included in the Outcome Measures 
and Procedures Manual , these guidelines have been taken into consideration 
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However, as modifications are made to these Items or new questions 
are added, the guidelines pertaining to question wording should be 
reviewed. 

How should the Items be sequenced? 

The sequence In which questions appear on a questionnaire Is always 
significant since It not only adds to the attractiveness of the 
Instrument but also sets the tone for responding to the questionnaire. 
As a general rule of thumb It Is suggested that a questionnaire 
should begin with a set of questions that w111 be most Interesting 
to the respondent. That Is, they should make the respondent want 
to answer them. Often questions concerning attitudes and satisfaction 
can serve this purpose, while questions regarding demographic 
variables w111 not. 

A second rule to follow In the sequencing of Items Is to group 
the Items that deal with the same topic* For example, on a former 
student questionnaire, questions concerning educational progress 
and plans could be one grouping and questions about occupational 
status and plans could be another grouping. 

A final consideration concerning Item sequencing Is that some 

people feel that Items which are more difficult to answer should 

be toward the end of the questionnaire unless they are crucial 

for setting the tone or Introducing the substance of the questionnaire. 



*^fter this rule has been considered. It might be good also to group 
according to Item format type, e.g., all Items on a particular topic 
that are "sentence-completion" should be grouped together. 



• What kinds of instructions should be included in the questionnaire? 
The instructions contained in a questionnaire are especially important 
for directing the respondent through the body of the questionnaire 

and for establishing and maintaining rapport with the respondent. — 
Instructions within the questionnaire also will help the respondent 
understand the purpose of the order of questions and make more 
sense out of the questionnaire as a whole. For example, in intro- 
ducing a series of questions that are designed to determine students' 
job career plans, it can be beneficial to preface the series with 
the statement: 

"The following four questions are intended to help us learn 
about your current and long-range occupational career plans 
and activities." 

• What kind of introductory cover letter should accompany the questionnaire? 
The letter that accompanies the questionnaire is also important for 
establishing rapport since it serves to introduce the total survey 

and its purpose. Very often the introductory letter is the key 
device that motivates the respondent to complete, the questionnaire. 
Generally, the more personal you can make the cover letter, the 
greater will be your chances of achieving a high response rate. 

• What pilot testing of the questionnaire will be conducted? 
Ideally, a pilot test (preliminary tryout) of the total survey should 

be conducted. Such a pilot test would include testing the sample design, the 
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questionnaire, the data gathering and processing procedures, and 
the data analysis to be carried out. At a minimum, a pilot test 
of the questionnaire to be used in the study should be conducted. 
Furthermore, the pilot version of the questionnaire should be to 
the extent possible an exact replica of the jquestionnaire that is 
intended for the actual study. If a final version of the question- 
naire has not been decided on, then alternative questionnaires 
should be tried out on different pilot samples. In this way, 
pilot test respondents will be reacting to the version that is 
likely to become the final instrument. 

Step 4: Collecting and Processing the Survey Data 

This major step involves the administration (assembly and distribution) of 
questionnaires and what should be done with them once they are returned, 
questions associated with this step are the following: 

• How will the questionnaire and its accompanying materials be 
assembled and distributed? 

In conducting a self-report questionnaire survey, special attention 
must be given to the distribution and collection of the questionnaires 
for the purpose of ensuring a high response rate. The method for 
administering a questionnaire that most often is employed involves 
the assembly of (1) the questionnaire, (2) an introductory letter, 
and (3) a return postage-paid envelope. An alternative method is 
the development of a self-mailing questionnaire that requires no 
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return envelope. This type of questionnaire is constructed in 
such a way that the return address and postage are printed on 
the questionnaire, and, therefore, the respondent can return it 
without the use of an envelope. (See alternative #3 for Outcome 
Measure 1-8 in Section IV of this manual for aq example of this 
latter alternative. ) 

A major drawback of this latter method is that it may place too much 
responsibility on the respondent who may not be willing to spend a 
great deal of time in preparing the questionnaire for its return 
(e.g., using a stapler to seal the questionnaire). Also, special 
post office requirements concerning the size and form of materials 
that can be mailed may cause unforeseen problems. Possibly the best 
suggestion that can be given is that no matter which method is used, 
you should assess what approach will be most accpetable to the respon- 
dents and also will meet the requirements of the postal authorities. 

It should be noted that for surveys of current students and faculty/ 
staff, non-mail methods may be appropriate for distributing self-report 
questionnaires. For example, questionnaires can be administered to 
faculty at faculty meetings, to current students at the end of a 
class or in their living unitSj_and. to graduating students when they 
register for graduation. The major advantage of this method is that 
if offers greater control over questionnaire response rate and allows 
for oral clarifying infonnation to be provided to the respondents. 
A problem can arise with this method if the respondents feel they 
are being hurried or imposed upon. Therefore, it is important to 
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sure the respondents do not feel they are being forced in any way to 
complete the questionnaire. 



• How will the returned questionnaires be monitored? 

The monitoring of returned questionnaires is another major concern in 

carrying out a survey since it sets the stage for data processing and, 

subsequently, data analysis. The following strategy has been suggested 

by Babbie (1973) for dealing with this issue: 
» 

First, prepare two return-rate tables. The first table should 
identify the number of questionnaires returned each day from 
Day 1 (the date the questionnaires are mailed) to the day 
that is the designated cutoff date for returned questionnaires. 
The second table should identify the cumulative number or 
percentage of the questionnaires that were returned. Again, 
start with the day the questionnaires were mailed as Day 1 and 
end with the designated cutoff date for the returned question- 
naires. The advantages of these two tables are that (a) they 
allow you to keep track of response rate to the mailed question- 
naires, (b) they provide ready-made tables that could be inclu- 
ded in the study report, and (c) they identify the size of 
the follow-up mailing that will be necessary. 

Once the two return-rate tables have been prepared, assign 
identification numbers to each of the questionnaires as they 
are returned. These identification numbers should be assigned 
serially. Such numbers can be valuable in estimating non- 
response biases in the survey. Babbie (1973) presented the 



following example to illustrate the utility of using these 
numbers : 

If grade-point average (6PA) reported by students 
decrease steadily through the data collection, with 
those replying right away having higher GPA's and those 
replying later having lower GPA's, then the research 
might tentatively conclude that those who failed to 
answer at all have lower GPA's yet. 

In giving this example Babbie cautions, "While it would not be 

advisable to make statistical estimates of bias in this fashion, 

the researcher could take advantage of approximate estimates." 

t What follow-up procedure needs to be used? 
Everything that has been suggested up to now concerning the development 
and administration of survey questionnaires has focused on the objective 
to obtain an acceptable response rate. However, almost every survey, no 
matter how carefully it has been planned and the materials have been 
developed, n^|ds a follow-up design. The primary reason for this is that 
a high response fate ensures that the sample of actual respondents approxi- 
mates the larger population and, therefore, valid conclusions can be made 
about the findings. ^ 

^ Generally, the follow-up design will call for the use of (1) a reminder 
letter or postcard, (2) a follow-up letter and a questionnaire, (3) a 
telephone follow-up, or (4) combinations of these three techniques. The 
exact follow-up procedure selected will depend on the situation at hand. 
However, several general suggestions are important to keep in mind: 
1. Make sure the follow-up is properly timed. Usually, there is a two 
week interval between the initial contact and the follow-up contact. 
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2. Make sure the nonrespondents can be identified at each stage of the 
fo11ow-up. One way that has been found useful In keeping track of 
nonrespondents In mail surveys Is to produce three sets of stick-on 
address labels. The first set can be used for the first mailing. 
When questionnaires are returned, the address label for the respondent 
can be removed from the second set of labels and placed on the question- 
naire for Identification purposes. Then when the fo11ow-up mailing is 
scheduled, the remaining labels of the second set can be used to address 
the envelopes or postcards. The third set Is then used to Identify 
those who return questionnaires after the fo11ow-up mailing and those 
who do not. 

3. Develop a return-rate graph to assess the effects of the Initial 
contact and subsequent fo11ow-up contacts. 

• What will be an acceptable response rate? 
As mentioned above, an acceptable response rate Is Important so valid 
conclusions can be made about the results. In mail surveys related 
to postsecondary education, response rates vary from 30 to 80 percent 

/ depending on the type of respondents. For example, a much lower response 
rate can be expected In dropout studies than In other kinds of outcome 
studies. 

A common procedure for computing the response rate Is as follows: 

1. Identify the Initial size of the sample. 

2. Subtract the number of persons In the Initial sample who did not 
receive questionnaires from the total number of persons In the Initial 
sample. 27 j 
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3. Divide the number of persons who returned completed questionnaires by 
the net number who received questionnaires. The percentage that is 
obtained identifies how successful the survey was in getting people 
to participate. 

For those persons who did not respond, it is always a good ide.a to check 
if there was a response bias (i.e., to determine if only a certain type of 
person responded or did not respond). 

• How should the data be processed? 

This question focuses on how the data will be coded, edited, formatted, 
and eventually stored (filed). Because of the importance of these considera- 
tions and the confusion that often surrounds them, a detailed discussion 
of a set of rules in this area is presented in Appendix E. 

Step 5; Analyzing the Survey Data 

This step is designed to dejermine what the data collected in the survey actually 
mean. The following two key questions need to be considered in this step: 

• What statistical techniques are needed to analyze the data ? 

The overall purpose of statistical analysis is to link the data back to 
the questions or hypotheses that motivated the study in the first place. 
In analyzing survey data, two basic types of statistical treatments of 
the data can be employed: (1) descriptive statistics and (2) inferential 
statistics. Descriptive statistics are appropriate when there is an 
interest in an accurate description or picture of the data. Generally, 
three methods can be used to achieve this objective: 
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1. * Description of the distribution of the "data through the 

Ml 

use of frequency distributions and percentages. 

2. Description of the central tendency of the data through 
the use of means, medians, and modes. 

3. Description' of the variability of the data through the 
use of standard deviations and ranges between the data. 

Inferential statistics should be applied when the questions or hypotheses 
of the study call for drawing Inferences or testing conclusions, or 
generalizing about the data. According to Hlllway (1969) Inferential 
statistics are Intended to answer questions like the following: 

- What Is the probable accuracy (I.e., reliability) of the 
measurements? 

- To what extent does the situation described by the 
data differ from what might be arrived at through 
mere chance? 

- To what extent Is there a relationship between two or more 
factors or variables dealt with In the study? 

Useful guides for selecting the appropriate statistical methods to be 
applied In a study have been prepared by Tatsuoka and Tiedeman In N.L. 
Gage's Handbook of Research on Teaching (1963) and by Slegel In his book 
on Nonparametric Statistics for the Behavioral Sciences (1966). 

wm a statistical computer program be used to analyze the data? 

A variety of statistical computer program . packages have been developed 

to aid researchers In the analysis of large amounts of data. Three of 

313 

27b 



the more well-known statistical packages used in analyzing survey-type 
data are: 

!• SPSS— Statistical Package for the Social Sciences bv N.H. Nie. 
D.H. Bent, and C.H. Hull, McGraw-Hill Book Co., New York, 1975. 

2. BMP— Biomedical Computer Programs by W.J. Dixon (Ed.), University 
of California Press, Berkeley, 1973. 

3. OSIRIS III by Survey Research Center ISR, University of Michigan, 
Ann Arbor, 1973. 

When considering the use of these statistical packages it is important 
to keep in mind: (1) their ease of use, (2) their availability to the 
researcher, and (3) the availability of the specific statistical analytic 
techniques in the statistical package. 

Step 6: Reporting the Survey Results 

This step is intended to help communicate the survey findings in a logical, 
clear, and accurate form. In short, it is the step in which the data are 
finally prepared in a form that they can be used in the decision-making process. 
Key questions to be considered in this step include the following: 

• Who will read and use the report? 
Having a clear understanding of who will read the survey report is extremely 
important for effectively communicating the results of the study. Very 
often different audiences will be interestedjn the findings. As a result, 
drafts of the survey report will have to be appropriate for different levels 
of Interest in the report and different levels ^ sophistication among the 
various readers. 
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• Will there be more than one report? 

In many cases a variety of reports will need to be developed that vary in 
form (oral and written) and length. For example, a lengthy written report 
that describes the study procedures followed and presents the findings in 
detail will probably need to be prepared for: the sponsor of the research. 
Often a shorter, more compact version of the full report will be needed to 
summarize the study and its findings for those persons who do not have time 
to read the full report and who are less interested in the various nuances 
and details of the study.* This shorter version of the report will quite 
often be more widely read and quoted. Therefore, it is important to 
select carefully the critical aspects of the study to be communicated in 
the report and to do so in a form that is attractive and easy to understand. 

• What tables, charts, and figures will be most useful in communicating 
the results of the study? 

Much thought should be given to how the data and results of the statistical 
analysis will be communicated in the reports. In choosing the types of 
tables, charts, graphs, and so forth to be used, it is a good idea to consider 
how familiar the audience is with statistical concepts and presentations. 
Also it is good to remember that "a picture is worth a thousand words" 
if it is a good one. (A good reference on characteristics of tables, 
charts, and figures can be found on pages 38-53 of Glass and Stanley's 
book. Statistical Methods in Education and Psychology , 1970.) 



*For survey findings to have naximum impact, it will also be desirable to 
prepare even shorter special reports for groups of decision makers having 
different concerns. The reports prepared for particular decision makers 
should focus only on those findings of importance to them. 
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• When wi n the report be needed? 
Although this is the last key question presented in this appendix, 
it is equally, if not more, important than all the other questions. 
Survey efforts are usually undertaken in postsecondary education 
institutions to provide information for decision-making purposes. 
As a result, if the report is not available when it is needed, then ^ 
all the time and energy that has been put into it has gone for 
naught. For this reason, it is important in planning the survey 
to develop an activity-time flow chart that specifies when each 
milestone has to be met. , ^ 

A Final Comment 

Obviously, the discussion presented in this appendix provides only a thumbnail 
sketch of the major steps and key questions to be considered in the question- 
naire survey process. It is hoped, however, that comments and suggestions 
which have been made about these steps and questions will serve as a set of 
minimum guidelines for ensuring the appropriate and useful application of the 
data collection procedures presented in this manual. 

To aid in further inquiry about the various components of the survey process 
mentioned in this appendix, a set of selected references follows. 
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INTRODUCTION 

Most data collection efforts proceed through several major stages: a design 
or planning phase, a collection or implementation phase, an analysis phase, 
and finally, a report-writing phase. Frequently, little attention is paid to 
the development of sensible coding and data formatting rules. It is the con- 
tention of this author that a considerable amount of money and effort could be 
saved on many data collection projects by the application of a few common-sense 
rules or guidelines for transcribing the data from raw response form to 
computer readable cards or tape. 

The intent of this handbook is to provide some rules or guidelines for those 
involved in the processing of data in preparation for computer analysis. (Some 
of the rules relate primarily to the problems associated with survey or ques- 
tionnaire data, but most ar& simply standard, common-sense procedures applica- 
ble to the processing of any input documents.) Throughout the handbook, several 
central themes are expressed: 

t The loss of information should be minimized between the raw 

document and the computerized form of the document, 
t Errors in transcribing the data should be minimized. 
• The programmer's problems in working with the data should be 
minimized. (This does not mean that the number of programs should 
necessarily be minimized^ but that decoding, subscripting, formatting, 
and other data handling problems should be kept to a minimum.) 

* 
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• The number of decision by coders and keypunchers should y 

-ts 

be minimized; I.e. 9 any data manipulation that can be done 
on the computer should not be done by hand. 

This handbook Is not Intended as a guide to good questionnaire design, although 
many of the suggestions given here are related to questionnaire design and 
should be taken Into account when planning the Instrument. Neither Is this 
handbook concerned explicitly with data analysis, though/again, there should 

be an Interaction between data analysis and data transcription considerations. 

f..^ , ^ 

There are numerous examples of time and money lost because of poor coding 
schemes, both in very large data collection efforts and in small one-person 
efforts. The guidelines which follow in this paper are an attempt to present 
some common-sense rules to use in coding data, deciding on a format for the 
data, and editing, sforihg, aM^ data for further use. Adher- 

ence to these guidelines should insure that the lata will never have to be 
repunched and that what is, punched will be a complete and accurate represen- 
tation of the raw data. 

This paper is organized into four sections: (a) coding guidelines; (b) data 
formatting guidelines; (c) keypunching and editing guidelines; and (d) docu- 
mentation and data storage guidelines. Within each section, a number of rules 
are included for insuring proper data transcription. Each rule is accompanied 
by a rationale explaining its purpose. Where appropriate, examples are inclu- 
ded and in some cases, exceptions to the rule. 
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guidelines for Coding Data 

Oo not assign a code of zero to responses, particularly 
categorical responses (see two exceptions below). 

o 

Rationale: Many computer languages cannot distinguish between zeroes 
and blanks; thus, special machine language programs may 
be required for this purpose. Also, package programs 
(e.g., SPSS, BMO) frequently have been written to accept 
categorical data Input as Integers beginning with "1". 
Finally, most computer languages do not allow a subscript 
of zero; thus, the programmer must remember to add "one" 
to all categorical variables that can have a value of 
zero before using the variable as a subscript. 

Example: The two responses YES/NO should be coded 1 = Yes and 2 = No 

or vice versa, not 0 = Yes, 1 = No. 

Assign a value of zero to a continuous variable that has 

a natural zero point (I.e., the number zero Indicates the 

absence of any quantity of the variable). An example of 

a questionnaire Item for which a code of zero makes sense 

Is the number of visits to a doctor In the past week. The 

other exception to Rule 1 Is In scoring tests with right 

and wrong answers. Traditionally a wrong answer Is coded 

zero and a correct answer coded as a "1", though there Is 

no compelling reason for this coding scheme. 
327 28t) 
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Exceptions: 
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Rule: 



Assign numeric codes to categories; do not use alphabetic 
codes to Indicate responses to variables. 



Rationale: Computers operate on numbers: any alphabetic codes must 
first be translated Into numbers before being tabulated, 
used as subscripts, or arithmetically manipulated. It Is easier 
and less costly In the long run to have numbers translated 
Into the alphabetic code they represient (when necessary 
for labelling purposes) than to translate alphabetic 
codes Into numeric codes. 

Example: The two responses YES/NO should be coded 1 = Yes and 

2 » No, not Y = Yes and N = No. 

Exceptions: Information for printing, labelling, or addressing purposes 
such as name of respondent, address, etc., can and should 
be stored as alphanumeric characters. A variable such as 
home state of respondent should be punched as a number If 
any tabulations will be performed using that variable 
for grouping purposes. 

Rule: Missing data values (the response left blank) should be 

coded as blanks (the card left blank In appropriate columns). 
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Rationale: Most packaged programs are designed to eliminate missing 
data (coded as blanks) from computations a^the option 
of the user. The use of a missing value code other than 
a blank will require extra cards or statements in running 
these programs. It also makes good sense to try to code 
the data for computer usage exactly like the original 
raw data as much as possible. 

Example: A missing achievement test score for a student respondent 

should be left blank on the appropriate card or tape 
columns; the card columns should not be filled with zeroes 
or some other missing value code such as 999. 

4. Rule: Don't punch or code decimal points (or other punctuation 

such as "$", commas, etc.). 

• 

Rationale: This rule has a number of justifications: (a) 

computers do not use punctuation (except the decimal 
point) such as "$" or commas; therefore, extra programming 
Is required If any punctuation Is punched; (b") decimal 
points are acceptable as computer Input bufnot required; 
since decimal points take up extra space on the card, 
require extra time to punch, and can be Indicated easily 
at the time of execution of the program. It Is not 
recommended that they be punched. Also, It sometimes Is 
necessary to move the decimal point In a number for 
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analysis In a particular program (If the program has a 
maximum or minimum range for variables); this can easily 
be accomplished if the decimal is not punched, but 
requires a special data transgeneratlon step if the 
decimal has been punched. 

Example: Data such as 98.112, 31.006 should be coded and punched as 

98112, 31006. Data such as $21,340.31 should be punched 
simply as 2134031. 

5. Rule: Don't change uncategori zed data Into categories, combine 

one or more responses into one code, or collapse categories 
^ of responses Into smaller number of categories at the 

time of coding or punching. 

Ratlorale: It Is not difficult in a computer program to combine or 

aggregate responses from cards or tapes. It can be costly 
and time consuming, however, for a future user of the data 
or the current user to decide that the unaggregated or 
uncombined responses are necessary to analyze the data 
properly and, therefore, have to recode and repunch some of 
the data. There is also a greater possibility of error In 
the punched cards or tape If a coder or keypuncher Is asked 
to mentally combine or transcribe responses while recording 
or punching them. 
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Example: A questionnaire Item with the fourth and fifth responses 
listed as "not applicable" and "don't know," respectively, 
should be coded separately as "4" and "5". even If the 
current analysis plans are to combine the two responses. 
Another example Is an Item that asks for the respondent's 
annual salary. Even If It Is planned that only three 
categories of salary will be used for analysis (e.g., 
high, middle, and low), the original salary or categories 
of salary should be coded and punched. 

6. Rule: Use Identical codes for all Items In a questionnaire with 

the same responses. ^ 

It will be easier for all persons working with the data to 
remember the numeric codes for responses If there Is unifor- 
mity throuchout the questionnaire or document to be' punched. 

Throughout the questionnaire or document, code Yes/No as 
1 = Y, 2 = N (or vice versa, although 1 = Y, 2 = N Is 
probably easier to remember). This rule applies particu- 
larly when most Items on a questionnaire list "yes" as 
the first response, followed by "no", but a few Items 
list these two responses In reverse order. The rule also 
applies In the case where some of the Items have an 
additional category such as "don't know" which should be 
assigned a code value of "3", even though "don't know" may 
be listed as. the first response. 
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Exceptions: If a questionnaire contains several Yes/No responses and 

some Items with an additional category such as '^uncertain," 
that logically falls between "yes" and "no". It Is better 
to code 1 = Y, 2 = U, 3 = N. The rationale for this 
exception Is that the response "uncertain" Is logically 
between the responses "yes" and "no" on a scale of how 
certain the respondent Is about the question asked. This 
_ £t exception does not Imply that other Items in the question- 

naire or document with only two responses (YES/NO) 
should then be coded 1 = Y, 3 = N (see rule 8). As Is 
explained In the next rule. It Is Important that numeric 
codes correspond to any underlying scale In the responses. 

7. Rule: Numeric codes for categorical responses should correspond 

to Implicit ordering of the responses. 

Rationale: Frequently, statistics such as the mean and standard 

deviation are required for categorical variables that have 
some underlying continuum. If the numeric codes for the 
categories have been assigned and punched logically (i.e., 
according to the Implicit ordering of the responses), no 
recoding will be necessary to compute such statistics. 
It Is also easier to remember the meaning of numeric codes 
for categories If they have been assigned according to a 
logical ordering scheme. 
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Example: Responses to an Item on a questionnaire might be (a) high, 

(b) low, and (c) In-between. According to rule seven, 
the numeric codes assigned should be Low s 1, In-between ~ 2, 
and High = 3. Thus, the lew category Is assigned a low 
number, and also the assigned numbers correspond to the 
Implicit ranking of the categories. 

Note: If the questionnaire has been written as described In the 

above example, neither the coder nor the keypuncher should 
be asked to perform the rearrangement of the codes to 
correspond to the Implicit ranking of the categories; 
rather, a simple transgeneratlon computer program should 
be run to assign the number codes to the proper responses. 
The coder or keypuncher should simply code or punch 
1 = high, 2 = low, and 3 = In-between so that transcription 
errors will be minimized. 

8. Rule: Code values assigned to response categories should be 

consecutive Integers ranging from "1" to K, where K Is 
the number of categories. 

Rationale: For most computing purposes, computations, cost, time, and 
confusion will be minimized by assigning consecutive Integer 
values to categorical responses. See also the rationale for 
rule 2. 
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Example: For a questionnaire Item with three possible responses: 

(a) never, (b) three times a week, and (c) six times a 
week, assign codes of one, two, and three rather than zero, 
three, and six to the responses. 

9* Rule: Where possible, assign standard codes to questionnaire 

responses. 

Rationale: The use of standard codes (where they exist) will facilitate 
any comparisons between the analytic results of the current 
study with past and future studies using the same data Items. 

Example: A data item for which numeric codes are needed might be the 

state In which the respondent lives. Clearly, every data 
collection effort In which this Information Is gathered 
could assign codes from one to 51 to the various states In 
the United States, but a more sensible approach is for all 
data collectors to use the same codes „ Thus, one should 
search through previous literature or other sources to 
find an existing coding system for states In the U. S. 
Other examples are the coding of occupation, education, 
ethnic group, college major field, etc. 
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Guidelines for Formatting Data 



10. Rule: Mviays assign a numeric Identification (ID) number and 

sequence number to every card in the data set so that each 
card has a unique number identifying its sequence. 

Rationale: There are several reasons for this rule: (a) if the cards 
get dropped, or out of sequence, ID numbers and card 
sequence numbers on each card make it easy to put the 
cards back in their proper order; (b) For some purpose, 
it may be necessary to create a file of, say, the fifth 
card for each respondent; (c) Supplementary data may need 
to be merged with each respondent's previous data. 

A questionnaire administered to 1300 respondents might 
require 149 card columns to punch all the responses. Four- 
digit ID numbers should be assigned to all persons and 
punched on all cards, and (since two cards will be required 
per respondent) card numbers (one and two) should be assigned 
and punched on each card. Thus, the card sequences should 
look like: 10011, 10012. 10021, 10022, etc. 

(a) ID numbers are often assigned beginning with 101» 1001» 
rather than 001, 0001, etc. This practice is generally a 
good one in that it sometimes requires extra programming 
effort to print ID numbers with leading zeroes (i.e., "001" 
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Example: 



Note: 



will usually be printed as "1" by the computer). K^* 
punchers, also, must be Instructed punch leading 
zeroes. Beginning the ID numbers with a "1" eliminates 
this problem, (b) It Is generally a good Idea to Include 
a sequence number In the format, even If there Is only one 
card per respondent, to facilitate adding additional cards 
for each respondent In the future. 

11. Rule: The ID number should be the first set of data on each 

card, followed by card or sequence numbers (within ID 
numbers), followed by frequently used respondent Informa- 
tion, with data responses appearing last on the card(s). 

Rationale: This rule Is based partly on tradition and partly on 
experience. Since the ID number and card numbers are 
frequently used pieces of Information, placing them first 
on each card saves time for the data user or progranmer. 
The same reasoning follows for such Information as sex, 
ethnic origin, curriculum, grade level, and other common 
grouping variables. If a number of computer runs are to be 
made, particularly on lengthy data records (several cards 
per respondent). It Is easier for everyone Involved In the 
analysis or programming to look for commonly used Informa- 
tion on the first card, rather than having to find respondent's 
sex on card two In column 59 and respondent's grade level on 
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card five, column 31, etc. Hopefully, the questionnaire or 
data gathering Instrument has also been organized with 
Important categorical variables listed first. 

As in the note with rule 7, If the questionnaire has not 
been organized as described in this rule, do not ask the 
coder or keypuncher to perform the rearranging of the 
data. A separate program should be run after the key- 
punching stage to accomplish this. 

The data format or lay-out should be organized in the 
same order as the questionnaire responses except where a 
conflict exists with rule 11. 

If the punched data format is in the same order as the raw 
data, it will facilitate the process of referring back and 
forth between the data gathering instrument and the data 
format. 

The format for a questionnaire with three parts should be 
arranged so that responses to the three sections are in 
the same order in both. Responses should also be in the 
same order on both documents within sections of the 
questionnaire. 
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Exceptions: Rule 11 should supercede this rule where there Is a 

conflict between the two guidelines; I.e., If the question- 
naire has been arranged such that certain Important 
grouping variables (such as sex of respondent » grade 
level 9 etc.) are burled In the middle of the questionnaire. 
It Is better to place them toward the beginning of the 
format, out of the order In which they were placed on the 
questionnaire. 



Rule: 



A data field, such as card sequence number or ID number, 
which appears on every card per respondent should be 
located In the same columns on each card. 



Rationale: A data field, such as ID number or card nurrt)er, that must 
be examined across cards (either by hand, using the card 
sorter, or In a program). Is extremely difficult to work 
with or use If it Is not punched in the same columns on 
every card, ' 



Example: 



If the ID number on card one Is 1332 in columns one 
through four, then card two should also contain the ID 
nurTri)er In columns one through four and similarly for the 
card sequence number In column five of both cards; e.g., 
columns 1-5 of card 1 should contain 13321, and card 2, 
13322. 
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Rule: In general, card columns should be filled, starting with 

column one, without spaces (blank columns) between the 
variables. 

Rationale: This rule Is more of a guideline than a rule, and the user 
must decide whether to follow It or not. There are two 
reasons for following this rule: (a) Inserting extra 
blank columns between variables may mean that more cards 
per respondent are necessary than the minimum required by con- 
tiguous, consecutive data. (This situation Is particularly a 
problem If two cards per respondent are required rather 
than just one, since one card per respondent Is much 
easier to deal with than two or more.) (b) If new data are 
ever added to the original, it Is easier to add them to 
the remaining right-most columns of the card format, 
than to add another card to the format or change the 
card format and compress the original variables together. 



Exception: When sight verifying of the cards Is planned or there are 
very few variables, separating variables by one or two 
blank columns can be helpful for distinguishing fields. 

Rule: Never assign more than one response to each column or 

position In the data format. 
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Rationale: Multiple punches in the same column always require 

specially written decoding programs to read the data. 
Any savings in formatting space gained by multiple 
punching will be lost in time and money required to read 
multiple punched data. 

Example: A questionnaire item requesting the respondent to "circle 

three choices" should be formatted with three columns, 
one for each possible choice of the respondent. 

Guidelines for Keypunching and Editing Data 

When sending cards to be keypunched or key taped, request 
that the cards be verified. 

Verifying cards or tapes costs about twice as much as 
simply having the cards punched but helps insure greater 
punching accuracy. 

If, for some reason, a small number of punching er*rors 
are acceptable, or if the number of cards to be punched 
is few enough that a sight check of accuracy can be 
performed, card or keytape verification Is unnecessary. 

When giving the data to the coder or keypuncher. Include 
very specific and precise instructions about the format 



16. Rule: 

Rationale: 



Exceptions: 



17. Rule: 
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and the coding scheme. Instruct the coder or keypuncher 
to call or ask about any questions he/she has and to 
set aside those documents about which there are unanswered 
questions. 



Rationale: Frequently, questions ^rlse during the coding or punching 
phase about which the data user must make decisions and 
must be aware. Without specific Instructions to call about 
questions* some keypunchers and coders will simply make 
their own decision and continue. 

18. Rule: Before setting up a data format and deciding on coding 

schemes, examine the responses to a few of the returned 
questionnaires. 

Rationale: Very often unusual or unexpected responses appear, particularly 
on questionnaires; examination of a few returned question* 
nalres before designing a format or setting up coding 
schemes will help Insure that the "strange'^ responses can 
be accommodated by the data format and response codes. 

19. Rule : Before finalizing the plans for the format and code values 

for the data, discuss both with someone who Is familiar ' 
with the kind of analysis programs that are or may be 
required. 
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Rationale: A data processing person (may be a research assistant, 

programmer, systems analyst, etc.) can often spot potential 
problem areas In either the format for the data or In 
particular choices for coding responses. 

20. Rule: Always make some kind of data editing check as the first 

step after the punched cards or keytape have been returned. 

Rationale: Without fall, some errors will occur In the process of 
transcribing raw data to tape or cards; therefore, at a 
minimum, bc-fore doing any analysis, a computer run should be 
made that prints out-of-range responses for all variables 
and checks for duplicate ID numbers and card numbers. (If 
the number of cards Is small, the editing check can be 
done by hand.) Examination of this output should point 
out errors where the data were out of the acceptable or 
reasonable range and where ID numbers were mispunched. 
Other errors, such as coding or keypunching errors where 
digits are reversed or mispunched within the acceptable 
range are harder to find: (a) If the data set warrants 
the procedure, there are a number of schemes for creating 
"check digits" to detect certain types of transcribing errors; 
(b) One can also check by hand a random sampling of questlon- 
t nalres against the corresponding punched cards or tape 
records to estimate the error rate for all questionnaires, 
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and simply report these values In the summary document 
for the stucty. 



Note: 



Data transgeneratlon or rearrangement tasks (see rules 
7 and 11) can be combined with the data editing run so 
that all three are accomplished In one program. 



Rule: 



Edit the entire data field for a variable; do not edit 
each column separately within the data field. 



Rationale: 



Example: 



Fewer errors will occur and less editing checks will be 
required If each variable Is edited as a field. 



The variable, SAT verbal score (range 200 - 800), should 
be edited as one field to check for scores less than 200 
or greater than 800. This variable should not be 
edited as three columns, the first ranging from two to 
eight and the second and third ranging from zero to nine. 



Rule: 



As a general rule, numbers should be punched right-justified 
and alphabetic characters punched left-Justified. 



Rationale: The term right-justified means that the data are punched 
all the way to the right In the field (e.g.. If columns 
21 through 23 contain a code for curriculum, then curriculum 
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code "1" will be punched as bbl rather than Ibb, "where "b" 
means a blank column). Left-*just1f1ed Is the reverse of 
right-justified (I.e., the name "Jones" In an eight column 
name field would be punched "JONESbbb" Instead of bbbJONES"). 
Alphabetic characters are normally used for printing and 
labelling purposes where It makes sense to punch the data 
as we read, from left to right. Numbers, on the other hand, 
are usually used for computations. In which case It makes 
sense to punch them the way we would write them to add up a 
column of figures. Also, "Ibb" would be read by the computer 
as "100" without special Instructions to the contrary. 

23. Rule: As a general rule, request that the keypuncher precede 

numeric fields with zeroes (zero-fill) when the number to 
be punched does not fill up the entire field. 

Rationale: Keypunching accuracy, rhythm, and speed will be Increased 
if each field requires the same number of punches for all 
respondents. 

Note: Alphabetic or character fields (left-justified) should be 

punched with blanks In any columns remaining In the field 
to the right of the punched data. 
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After the keypunching and after the final editing phases, 
obtain a listing of the raw data for documentation and 
reference purposes'. 

There are many times during the data editing and even the 
analysis phase of a project when it is necessary to refer 
back to the raw data. The cards could be used for this 
purpose, but a paper listing is easier to handle, and does 
not jeopardize the order or the condition of the cards. 

Note: If the complete set of data is extremely large (so 

that a complete data listing woyld be cumbersome and 
require a large volume of paper), a listing of the first 
100 records or every Nth record is still recommended 
(where N is selected so that 100 to 200 records are 
printed). When all the editing and modifications to the 
data are completed, a complete listing should then be 
obtained for documentation and reference purposes. 



Guidelines for Documenting and Storing Data 

25. Rule : Document, in writing, all phases of the coding, punching, 

formatting, and editing steps. 



24. Rule: 



Rationale: 
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Rationale: 



26. Rule: 



Rationale: 
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It Is easy to forget, even after three or four weeks, why 
a decision was made or what the decision was. It Is a good 
Idea to make notes through the entire data transcription 
process of why and what decisions were made. Particularly 
Important Is a careful, up-to-date set of documentation on 
the data format and coding assignments. If very extensive 
data editing Is necessary. It Is also Important to document 
any editing rules and any changes made to the original 
punched data. 

After any Important (costly) change In the data, Inunedlately 
make a duplicate copy of all the data for storage separately 
from the working copy of the data. 

If the data are stored on cards, problems can occur such 
as the cards being dropped, torn by the card reader, 
sorter, etc., or simply lost. If the data are stored 
on tape or disk file, the tape can be misplaced, and both 
tape and disk files can be Inadvertently scratched (erased). 
Thus, It Is Important, no matter what storage form Is 
used to keep a duplicate copy of the data. This rule 
applies primarily to three key points In the data trans- 
cription process: (a) after the data have been received 
from the keypunching area; (b) after any costly computer run 
creating new or modified data; and (c) after the data have 
been edited and finalized. 
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Note: For long-term storage of Important tapes, one copy of the 

data should be stored In a location such that a fire or other 
damage In one area would not destroy the second copy of the 
data. ^ For short-term storage, cards should be stored 
packed tightly together In an upright position (without 
rubber bands), preferably In a file made for storing 
cards. Cards should be read to tape for long-term storage. 

27. Rule: When storing tapes or cards, write all identifying infor- 

mation on the tape label or cards and. If possible, store 
Identifying Information with the data. 

Rationale: After a short period of time, unlabel led tapes or cards are 
difficult to Identify; It makes good sense to write on the 
cards (across the top of the deck or on the first card) or 
attach a label to the tape specifying all Identifying 
Information. A copy of the data format can also be folded 
and stored next to the cards or Inside the tape cover. 
The Identifying Information should Include: (a) creation 
date, (b) description of data, (c) sequential run or data 
set number, and (d) all Information required for using the 
tape or cards. 

Note: When storing cards, It Is a good Idea to put a diagonal 

line across the top of all the cards (with a felt- tip pen) 
and to write "F/C" and "L/G" on the first and last cards, 
respectively. 
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Summary 

Preparing a good data file from raw input data is an important and often 
neglected phase of ary effort Involving data collection. By following the 
guidelines given in this paper, it is hoped that some of the problems that 
occur In preparing a^data file can be avoided. It is obvious from the rationale 
for mn^ of the rules given hare, that creating a good set of computerized 
data is, to a large extent, a matter of applying common sense: thinking 
through how the data will be used, who will use the data, and what form of the 
data will be required for current and future analyses: in short, preparing 
for multiple contingencies. 

For quick reference, the rules have been listed again below in abbreviated 
form: 

1. Do not assign a code of zero to responses, particularly categorical 
responses. 

2. Assign numeric codes to categories; do not use alphabetic codes to 
indicate responses to variables. 

3. Missing data values should be coded as blanks. 

4. Don't punch or code decimal points (or other punctuation such 
as "$", commas, etc.). 

5. Don't change uncategori zed data into categories, combine one or 
more responses as one code, or collapse categories of responses into 
smaller number of categories at the time of coding or punching. 

6. Use identical codes for all items in a questionnaire with the same 
responses. 

7. Numeric codes for categorical responses should correspond to Implicit 
ordering of the responses. 
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8. Code values assigned to response categories should be consecutive 
Integers ranging from "1" to K. where K Is the number of categories. 

9, Where possible, assign standard codes to questionnaire responses. 

10. Always assign a numeric Identification (10) number and sequence 
number to every card In the data set so that each card has a 
unique number Identifying its sequence. 

11. The ID number should be the first set of data on each card, followed 
by card or sequence numbers (within ID numbers), followed by 
frequently used respondent information, with data responses 
appearing last on the card(s). 

12. The data format or lay-out should be organized in the same order 
as the questionnaire responses except where a conflict exists with 
rule 11 . 

13. A data field, such as card sequence number or ID number, which 
appears on every card per respondent should be located in the same 
columns on each card. 

14. In general, card columns should be filled, starting with column 
one, without spaces (blank columns) between the variables. 

V ■ 

15. Never assign more than one response to each coluifin or position in 
the data format. 

16. When sending cards to be keypunched or keytaped, request that the 
cards be verified. 

17. When giving the data to the coder or keypuncher. Include very 
specific and precise instructions about the format and the coding 
scheme. Instruct the coder or keypuncher to call or ask about any 
questions he/she has and to set aside those documents about which 
there are unanswered questions. 

18. Before setting up a data format and deciding on coding schemes, 
examine the responses to a few of the returned questionnaires. 

19. Before finalizing the plans for the format and code values for the 
data, discuss both with someone who is familiar with the kind of 
analysis programs that are or may be required, 

20. Always make some kind of data editing check as the first step 
after the punched cards or keytape have been returned. 

21. Edit the entire data field for a variable; do not edit each column 
separately within the data field. 
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22. As a general rule, numbers should be punched right-justified and 
alphabetic characters punched left-justified. 

23. As a general rule, request that the keypuncher precede numeric 
fields with zeroes {7.ero-fill) when the number to be punched does 
not fill up the entire space. 

24. After the keypunching and after the final editing phases, obtain 

a listing of the raw data for documentation and reference purposes. 

25. Document, in writing, all phases of the coding, punching, formatting, 
and editing steps. 

26. After any important (costly) change in the data, immediately make 
a duplicate copy of all the data for storage separately from the 
working copy of the data. 

27. When storing tapes or cards, write all identifying information on 
the tape label or cards and, if possible, store identifying Infor- 
mation with the data. 
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GLOSSARY " 

Alphabetic Codes - Codes that contain any letters from the alphabet or punc- 
tuation (except the decimal point or plus or minus signs). 

Alphanumeric Codes - Codes that contain alphabetic characters, numeric 
characters, and/or punctuation. 

Blank - Code used to Indicate missing data; a blank card column Is one that 
contains no punch. 

Card - A data storage medium; each card contains 80 columns. 

Card Number - Code used when there is more than one card per respondent to 
Indicate the sequence of cards within ID numbers. 

Categorical Variable - A variable which has discrete responses; I.e., the response 
can be placed in one of several categories; e.g., curriculum is a categorical 
variable which might have two responses: academic and nonacademlc. 

Character - One numeric digit, alphabetic character, or punctuation mark. 

Code - The numeric (or occasionally alphabetic) representation of responses; e.g., 
the codes for male and female might be designated as "1" and "2", respectively. 

Coder - The person who examines documents, assigning codes to responses where 
necessary, before documents are keypunched. 
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Column One of 80 positions on a card. Also means one position on the data 
format for cards, tape, or disk. 

i\ 

Continuous Variable - A variable which can take on any value within a 

specified range; e.g. annual salary Is a continuous variable that can 
take on values from zero to Infinity (theoretically). 

Data Field - See field. 

Data Set - See file. 

Disk - A data storage medium, similar to tape In terms of usage. 

Editing - The process of checking coded data on cards, tape, or disk against 
the raw data (e.g., questionnaire) to correct errors that occurred 
during transcription. 

Execution of a Program - The actual running of a program through the computer. 

i 

Field - The columns allocated on the data format to one variable; e.g., the 
ID number might occupy four columns: these four columns are referred to 
as the ID field. 

File - Ar\y set of computerized data that logically oelongs together; e.g., 
all the punched cards from a questionnaire administration might be 
called a file. 
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Format - A written description of all variables in a data record, their 
location (coliimn positions), and codes for categorical variables or 
ranges for continuous variables. 



ID Number - The unique identifying number for every respondent for which 
there is a card or data record. 

Item - One question on a survey or questionnaire. 

Job - A computer run. See execution of a program. 

Keypunch - The machine that punches cards for computer input or the process 
of punchtnq data onto cards. 

Keytape - A keypunch-like machine that produces computerized data on tapes 
Instead of cards. 

Leading Zeroes - Zeroes punched in the left-most columns of a numeric 

field when the datum to be punched does not fill the entire field; e.g., 
ID number one punched as "0001" has three leading zeroes. 

Lay-out - See format. 

Left-justify - Punched data beginning in the left-most column of the field; 
e.g., the name "JONES" in an eight column field, left-justified, is 
punched "JONESbbb," where "b" means a blank column. Left-justlf^tion 
is used for alphanumeric data. 



Listing - A computer-produced paper copy of the data. 

Missing data - Responses left blank by the questionnaire respondent, or 
data which are unobtainable. 

Numeric Codes - Codes which contain only numbers (the digits zero to nine) 
with or without a decimal point or a sign (plus or minus). 

Output - The results obtained from the running of a program. 

Package Program - Any of a number of previously written computer programs 
available to perform data analysis and manipulation. 

Print-out - Output on paper. 

Punch - The square holes on a computer card designating numeric and 
alphabetic codes in each column of the card. 

Record - The set of data fields connected physically (all fields on one card) 
or logically (all fields for one respondent). 

Response - The answer given to an item or the Information recorded for a 

particular variable; e.g., a questionnaire item that asks, "What Is your 
sex?" has two possible responses: male and female. 
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Sequence number - See card number. 

Subscript - A number associated with a categorical variable that designates 
response codes; e.g., the variable 'sex of respondent' might have 
responses designated S^ and to indicate male and female. 

Tape - A data storage medium for the computer. 

Transgeneration - The process of converting one type of code to another; 
e.g., (a) the continuous variable, salary, night be transgenerated 
so that there are three salary categories: high, medium, and low; 
(b) a variable coded as "1", "2", "3" might be transgenerated so that 
the codes are "3", "1", and "2", respectively. 

Verification - The process of checking punched cards (or tape) for accuracy. 
Sight verification is done by hand and machine verification is done by 
the keypuncher with a special verifying keypunch. 

Zero-fill - An instruction to the coder or keypuncher that leading or trailing 
zeroes are to be punched or coded in numeric fields. 
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